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PREFACE 


Technical  reporting  of  the  measurement  and  analyses  of  ASR-4  terminal  radar 
system  error  under  project  142-177-010  is  organ?  «.cl  into  three  parts.  To 
facilitate  independent  or  exclusive  use  of  either  report,  each  contains  a 
sufficient  description  of  methodology,  d.ita  bank  development,  and  the  analyses 
which  are  repor.ed. 

PART  I;  OVERVIEW 

This  report  is  intended  to  present  a general,  nontechnical  description  of  a 
limited  set  of  the  results  which  were  developed  in  multivariate,  multidimensional 
experiments  using  a large  data  sample.  To  achieve  maximum  clarity  and  simplify 
reader  understanding  of  the  overall  effort,  a very  minimum  of  statistical  data 
is  presented  in  this  report,  and  basic  trends  ere  described  without  expansion 
to  describe  or  explain  anomalies.  More  detailed  Treatments  are  presented  in 
the  associated  reports. 

PART  II:  ANALYSES 

This  is  the  main  study,  and  it  consists  of  three  independent  data  collection 
programs  and  independent  analyses.  The  report  describes  in  detail  the  results 
of  extensive  data  analysis  and  presents  tables  of  summary  statistical  values 
for  the  two  major  data  sets,  which  are  categorized  as  "Phase  1 Data"  ar.d  "Phase 
II  Data." 

PART  III:  SUMMARY 

The  Summary  is  a compendium  and  consolidation  of  the  numerous  analyses  and 
subsets  of  data  appearing  in  the  main  report,  "Part  II:  Analyses."  To  relieve 
the  reader  ot  nonsignificant  differences  that  result  in  three  independent 
studies  on  a common  problem,  all  similar  system  response  measures  were  pooled, 
and  combined  into  a single  expression;  and  analysis  of  variance  was  then 
performed  for  the  pooled  expressions.  Tne  general  effect  was  that  the  data 
thus  becomes  more  homogeneous,  and  less  subject  to  extraneous  effects. 

The  extensive  and  complex  nature  of  data  collection  and  data  analysis  for  these 
studies  involved  many  participants  whose  individual  contributions  merit  commen- 
dation, which  can  be  made  only  generally.  However,  a few  individuals  must  be 
specially  cited. 

We  appreciate  the  direction  and  consultation  provided  by  Mr.  Walter  Faison,  for 
Systems  Research  and  Development  Service,  and  Mr.  William  Broadwater,  for  Air 
Traffic  Service,  who  largely  developed  the  program's  conceptual  approach. 

We  are  very  pleased  to  acknowledge  the  gjidance  and  technical  assistance  of 
Dr.  J.  Stuart  Hunter,  of  the  Princeton  University  School  of  Engineering,  for 
his  painstaking  and  enthusiastic  support  in  the  statistical  analysis  and 
modeling  effort. 
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INTRODUCTION 


PURPOSE 

The  technical  objective  of  this  project  was  to  conduct  measurements  of  system 
error  in  the  air  traffic  control  terminal  area  radar  system  and  to  perform 
analyses  to  provide  a more  quantitative  basis  for  related  decision  making. 

BACKGROUND 

The  Federal  Aviation  Administration  (FAA)  Air  Traffic  Service  (ATS)  requested 
from  the  FAA  Systems  Research  and  Development  Service  (SRDS)  a quantitative 
analysis  of  the  errors  in  range,  azimuth,  geographic  position,  and  separation 
which  are  associated  with  aircraft  position  information  derived  by  a typical 
terminal  area  search  radar  system. 

Data  collection  was  performed  at  the  National  Aviation  Facilities  Experimental 
Center  (NAFEC) , Atlantic  City,  New  Jersey,  by  tracking  two  test  aircraft  with 
instrumentation  radars,  photographing  radar  targets  displayed  by  the  field- 
operational  Atlantic  City  ASR-4,  and  then  comparing  the  related  target  position 
reports  from  these  two  sources.  Extensive  analyses  were  performed  by  the 
Analysis  Branch  at  NAFEC  supported  by  computer  services  at  Princeton  University. 

The  SRDS  project  objective  specified  that  an  airport  surveillance  radar  (ASR) 
which  was  operational  in  an  ATS  field  facility  would  be  used  to  conduct 
measurements  of  the  positional  accuracy  of  the  radar  targets  displayed  on 
two  types  of  radar  indicators,  the  standard  plan  position  indicator  (PPT) 
and  the  scan-converted  radar  bright  display  equipment  (RBDE) . Measurements 
were  specified  to  include  the  positional  accuracy  of  the  displayed  target 
for  a set  of  altitudes  and  ranges,  measurements  of  range  and  azimuth  resolution 
through  a range  of  altit  Jes , and  under  conditions  of  losing  resolution  and 
then  regaining  it,  and  that  such  measurements  would  consider  both  raw  radar 
and  beacon  (primary  and  secondary  radar  respectively). 

These  specifically  defined  measures  were  to  be  used  to  provide  a series  of 
statistical  estimates  showing  the  probability  of  various  values  of  measured 
separation  of  aircraft,  both  relative  and  geographical,  through  a range  of 
critical  values. 

The  key  interest  may  be  expressed,  ''What  is  the  separation  error  between 
aircraft  targets  displayed  in  an  air  traffic  control  terminal  area  radar 
system?"  i 


PROJECT  METHODOLOGY 


METHOD  OF  APPROACH 

The  basic  measurement  sought  in  response  to  the  Air  Traffic  Service  request 
was  the  difference  between  displayed  aircraft  position  and  actual  aircraft 
position.  This  difference  was  considered  to  be  the  system  error  in  positional 
accuracy  of  the  aircraft  radar  target. 

The  difference  between  the  displayed  aircraft  target  position  and  the  true 
geographical  position  of  the  aircraft  was  treated  as  the  total  system  error 
and  was  measured  at  the  point  of  service.  This  is  to  say  that  component  errors 
of  the  electronic  system  which  produces  and  displays  the  aircraft  radar  target 
are  not  considered  independently.  The  measurement  data  was  collected  at  that 
point  in  the  air  traffic  control  system  where  the  air  traffic  controller  observes 
aircraft  target  position  relative  to  other  aircraft  radar  targets  (or  known 
obstructions),  and  uses  this  positional  information  as  a basis  for  his  judg- 
ments in  the  exercise  of  air  traffic  control  service.  Moreover,  no  considera- 
tion was  made  of  human  factors,  such  as  the  controllers'  visual  acuity  or 
response  lag. 

To  treat  the  system  error  thus  defined,  it  was  necessary  (1)  to  acquire  an 
adequate  data  sample,  (2)  to  compute  its  statistical  characteristics,  (3)  to 
estimate  therefrom  population  parameters  relating  to  accuracy  and  precision, 
and  (4)  to  develop  predictive  statements  about  the  expectancy  of  various  kinds 
and  amounts  of  error. 

DATA  COLLECTION 


Measurement  of  displayed  aircraft  radar  target  position  was  made  by  photo- 
graphing radar  displays  which  used  input  from  the  Atlantic  City  ASR-4  airport 
surveillance  radar  system  Four  displays  were  photographed  in  each  data  run. 

Two  of  these  displays  were  scan-converted  RBDE-5  displays,  and  two  were  PPI 
displays.  One  display  of  each  pair  presented  the  radar  targets  of  interest 
in  beacon  radar  mode,  and  one  display  of  each  pair  presented  the  targets  of 
interest  in  raw  radar  mode  (figure  I).  The  acquired  film  data  thrs  fulfilled 
the  specified  requirements  for  information  from  both  prima- . radar  and  secondary 
radar  displays  and  also  from  both  scan-converted  and  PPI  displays. 

Each  radar  display  was  equipped  with  a camera,  frame-mounted  to  record  total 
display  scope  coverage  and  automatically  triggered  to  expose  one  frame  of 
film  for  each  scan  of  the  surveillance  radar  antenna,  one  frame  of  film  each 
4 seconds  (figure  2).  For  time  correlation  with  other  measurement  data,  each 
display  wa3  equipped  with  a presentation  of  clock  time  which  would  be  recorded 
on  film  to  the  nearest  0.1  seconds  of  camera  trigger. 
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FIGURE  3.  EAIR  FACILITY  DATA  FLOW  DIAGRAM 
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FIGURE  4.  TAIR  FACILITY  DATA  FLOW  DIAGRAM 


PROJECTOR 

MIRROR 


FIGURE  5.  TELEREADEX  FILM  READER  EQUIPMENT 


tapes,  this  data  was  computer  processed  to  translate  and  rotate  the  measurements 
from  the  source  points  of  the  EA1R  and  TAIR  radar  antennas  to  the  source  point 
of  the  Atlantic  City  ASR-4  surveillance  radar  antenna,  and  the  data  was 
converted  from  rho-theta  to  X and  Y. 

DATA  BANK  TAPE 


A special  computer  program  was  developed  to  combine  the  position-time-space 
data  from  EAIR/TA1R  magnetic  tapes  and  Telereadex  punched  >.ard  output  (figure  6) 
and  to  record  the  following  basic  measures  on  master  data  bank  tapes  for  use 
in  statistical  analysis: 


1. 

Aircraft 

One 

2. 

Aircraft 

One 

3. 

Aircraft 

One 

4. 

Aircraft 

One 

5. 

Aircraft 

One 

6. 

Aircraft 

Two 

7. 

Aircraft 

Two 

8. 

Aircraft 

Two 

9. 

Aircraft 

Two 

10. 

Aircraft 

Two 

precision  radar  track  position  (from  TAIR); 
film  position,  primary  radar  mode,  PP1  display, 
film  position,  beacon  radar  mode,  PPI  display; 
film  position,  primary  radar  mode,  RBDE  disp'  </; 
film  position,  beacon  radar  mode,  RBDE  display; 

precision  radar  track  position  (from  EAIR) ; 
film  position,  primary  radar  mode,  PPI  display; 
film  position,  beacon  radar  mode,  PPI  display; 
film  position,  primary  radar  mode,  RBDE  display; 
film  position,  beacon  radar  mode,  RBDE  display. 


The  project  data  reduction  program  also  developed  for  the  master  data  bank 
tapes  the  following  calculated  measures: 

1.  Aircraft  One  Slant  Range  Error 

2.  Aircraft  One  Azimuth  Error 

3.  Aircraft  One  Composite  Error 

4.  Aircraft  One  Geographic  Error 

5.  Aircraft  One  Composite-Geographic  Error 

6.  Aircraft  One  Ground  Range 

7.  Aircraft  Two  Slant  Range  Error 

8.  Aircraft  Two  Azimuth  Error 

9.  Aircraft  Two  Composite  Error 

10.  Aircraft  Two  Geographic  Error 

11.  Aircraft  Two  Composite-Geographic  Error 

12.  Aircraft  Two  Ground  Range 

13.  Separation  Error  (between  Aircraft  One  and  Aircraft  Two) 


The  data  bank  tape  consists  of  one  data  record  for  each  4-second  period  of 
live  flight  data  collection,  except  where  deleted  in  quality  control  data 
editing.  Each  record  includes  the  basic  and  calculated  measures  listed  above 
as  well  as  clock  time.  Records  are  blocked  into  data  "cases,"  equivalent  to 
flight  on  one  radial,  in  one  direction  at  one  altitude  and  flight  pattern. 

From  the  data  bank,  the  various  system  response  variables  were  calculated  and 
analyzed  according  to  the  experimental  design. 
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FIGURL  c.  L-.TA  REDUCTION  FXOW  CHART 


EXPERIMENTAL  DESIGN  AND  ANALYSIS 


SAMPLE  AIRSPACE 


A cylindrical  airspace  50  nautical  miles  in  radius  from  the  Atlantic  City 
ASR-4  radar  antenna  (sited  at  NAFEC)  and  from  ground  level  (14  feet  mean  sea 
level)  to  20,000  feet  mean  sea  level  was  selected  ao  the  area  to  be  sampled 
(figure  7).  The  radius  of  50  nautical  miles  was  established  from  consideration 
of  present  operational  and  jurisdictional  interests  of  air  traffic  control 
terminal  area  facilities.  Operational  field  facilities  which  provide  radar 
service  very  commonly  use  a range  setting  of  30  nautical  miles  on  their  radar 
displays.  However,  recent  developments  in  terminal  area  air  traffic  control 
service  have  extended  the  area  of  interest  for  the  terminal  area  air  traffic 
controller. 

Within  the  selected  sample  area,  observations  were  sought  in  each  of  the  four 
quadrants.  Flight  paths  for  the  test  aircraft  were  aligned  with  the  approximate 
bisectors  of  the  four  quadrants  defined  by  the  cardinal  points  of  the  compass. 
The  natural  fall  of  terrain  was  so  oriented  to  the  prescribed  flight  paths  that 
it  was  possible  to  sample  possible  effects  on  radar  accuracy  in  relation  to 
over-land,  cver-water,  and  over-marsh  (mixed)  conditions. 

The  course  bearings  from  the  Atlantic  City  ASR-4  radar  antenna  site  which 
define  the  flight  paths  of  the  data  runs  were  050°,  140°,  230°,  and  320°.  These 
were  designated  (in  data  labelling,  etc.)  "radials"  1,  2,  3,  and  4 respectively, 
in  clockwise  order  from  true  north.  Navigation  was  actually  accomplished  by 
flying  the  corresponding  radials  of  the  Atlantic  City  VORTAC  station,  very 
closely  adjacent  to  the  ASR-^  antenna  site. 

ALTITUDES 


Test  flights  for  data  collection  were  performed  at  flat  altitudes  of  20,  14, 

8,  and  3 thousand  feet.  Altitude  separation  of  500  feet  vertical  spacing  was 
assigned  so  that  the  maneuvering  aircraft  could  cross  under  the  nonmaneuver- 
ing aircraft  without  varying  its  own  constant  altitude.  Otherwise,  vertical 
spacing  was  of  no  interest  as  a test  objective,  since  displayed  aircraft  radar 
targets  vary  in  only  the  two  horizontal  uimensions. 

FLIGHT  PATTERNS 


Specified  flight  patterns  for  each  data  run  were  designed  to  consider  either 
range  separation  (spacing)  or  azimuth  separation  between  radar  targets  when 
presented  on  a radar  display.  Three  flight  patterns  were  specified  to  be  flown 
at  each  of  the  assigned  altitudes,  starting  at  the  50-nautical-mile  periphery 
of  the  sample  area  and  proceeding  inbound  to  overhead  the  radar  antenna  site, 
and  thence  outbound  on  the  reciprocal  course  to  the  opposite  50-nautical-mile 
point.  For  purposes  of  test  replication,  the  same  patterns  were  subsequently 
flown  on  the  opposite  headings  (figure  8). 
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PHASL  1 RUN  1 


PHASL  1 m'N  ) 


• VOHTAC  SIT L 


FIGURE  8 


PHASL  I 


HUN  i 


PHASKS  I AND  II 


TOTAL  FLIGHT  PATTERN  COVIIRAC.K 
FOB  60  RUNS 


FLIGHT  PATTERNS 


In  the  tandem  flight  pattern  (for  the  050°  radial  and  its  reciprocal  course 
230°  for  example),  the  "lead  aircraft"  (nonmaneuvering  aircraft)  started  the 
test  run  at  assigned  altitude  and  at  the  50-nautical-mile  DME  fix  on  the  050° 
radial  of  the  Atlantic  City  VORTAC  heading  inbound,  thence  navigated  a straight 
course  on  the  050°  radial  to  overfly  the  radar  antenna,  and  then  navigated 
outbound  on  the  230°  radial  to  termination  of  -.he  data  run  ?t  the  50-nautical- 
mile  DME  fix  of  the  230°  radial.  The  maneuvering  aircraft,  trailing  the  lead 
aircraft  along  the  same  radials,  made  speed  adjustments  to  vary  the  longitudinal 
spacing  between  the  two  aircraft  from  7 nautical  miles  to  zero,  and  then  back 
to  the  maximum  of  7 nautical  miles.  This  alternate  catch-up  and  fail-back 
maneuver  along  defined  VORTAC  radials  was  intended  to  vary  range  spacing  while 
maintaining  as  nearly  as  practicable  a constant  azimuthal  relationship  between 
the  targe*,  aircraft. 

The  other  two  specified  flight  patterns,  open  weave  and  closed  weave,  were 
designed  to  vary  the  azimuthal  relationship  between  the  two  test  aircraft  while 
maintaining  a minimum  difference  in  their  respective  ranges  from  the  radar 
antenna  throughout  each  run. 

In  both  of  the  weave  patterns,  the  lead  aircraft  navigated  in  the  same  manner 
as  in  the  tandem  pattern,  in  a straightline  course  inbound  from  a 50-nautical- 
mile  DME  fix  on  one  of  the  specified  radials,  to  over  the  radar  antenna  site, 
thence  outbound  to  the  50-nautical-mile  DME  fix  on  the  reciprocal  radial. 

In  the  open  weave  pattern,  the  maneuvering  aircraft,  maintaining  throughout 
the  run  as  closely  as  possible  the  same  range  from  the  VORTAC  as  the  lead 
aircraft,  initiated  the  data  run  inbound  at  a range  of  50  nautical  miles  from 
the  VORTAC,  but  7 nautical  miles  laterally  from  the  lead  aircraft.  Thence, 
the  maneuvering  aircraft  executed  a series  of  weaves  about  the  lead  aircraft 
such  that  a crossover  beneath  the  lead  aircraft  was  executed  at  ranges  of 
37.5  and  12.5  nautical  miles  (these  equatable  with  zero  azimuthal  spacing) 
and  lateral  spacing  of  7 nautical  miles  was  reestablished  about  25  nautical 
miles  on  each  side  of  the  antenna  site,  passing  the  antenna  site,  and  at  the 
outbound  50-nautical-mile  DME  fix. 

The  closed  weave  flight  pattern  was  performed  identically  to  the  open  weave 
flight  pattern,  except  that  maximum  lateral  spacing  was  specified  for  ranges 
of  37.5  and  12.5  nautical  miles,  and  minimum  lateral  spacing  (cross-under) 
was  specified  to  occur  at  50  nautical  miles  and  25  nautical  miles  on  both  sides 
of  the  antenna  site,  and  overhead  the  antenna  site. 

Each  of  the  three  flight  patterns  was  executed  on  the  140°/320°  radials  as 
well  as  on  the  050°/230°  radials.  For  purposes  of  test  replication,  all  three 
flight  patterns  were  also  executed  in  a subsequent  data  set  (Phase  II)  on  aircraft 
headings  reciprocal  to  those  used  in  the  first  data  set  (Phase  I). 
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RANGE  BLOCKING 


Radar  displays  in  the  ground  environnent  test  laboratory  were  set  for  a range 
of  50  nautical  miles  while  the  aircraft  were  beyond  30  nautical  miles  inbound 
and  25  nautical  miles  outbound,  and  were  switched  to  a range  setting  of 
30  nautical  miles  when  the  aircraft  were  within  these  limits. 

It  should  be  no»°d  that,  while  this  variable  of  the  test  conditions  is  described 
in  terms  of  display  radar  range  setting,  the  effect  is  to  change  the  scale  on 
the  display.  All  the  radar  displays  used  in  these  tests,  whether  PPI  or 
scan-converted  (RBDE-5),  were  types  specified  as  22-inch;  the  effective  display 
face  diameter  being  slightly  less  than  this  dimension.  The  impact  of  the  scale 
change  (range-setting  change)  on  the  measurements  should  be  expected  in  the 
range  block  variable  Q1  (zero  to  25-nautical-mile  range)  and  Q2  (25-  to  50- 
nautical-mile  range). 

TEST  DESIGN 


The  six  basic  test  conditions,  with  their  various  treatment  leveis,  comprised 
a factorial  test  design  which  was  multidimensional  as  well  as  multivariate. 

To  recapitulate,  the  conditions  were  as  follows: 


Variable 


Treatment  Data 

Levels  Code 


Radar  Mode 
Display  Type 
Flight  Pattern 
Radial  (Course) 
Altitude 
Range  Block 


2 

2 

3 

4 
4 
2 


T 

D 

F 

R 

A 

Q 


A graphic  matrix  of  the  complete  test  design  (figure  9)  depicts  the  schematic 
relationship  of  the  various  test  conditions  and  treatment  levels. 


MEASUREMENTS 


Four  types  of  error  measurements  were  derived  from  the  basic  data  bank:  (1) 

range  error;  (2)  azimuth  error;  (3)  position  error,  which  is  the  vector  derived 
from  the  range  error  and  the  azimuth  error;  and  (4)  the  relative  separation 
error.  In  this  report,  these  measurements  are  all  expressed  in  terms  of 
nautical  miles. 
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Legend; 


Radar  .Modi' 
Display'  Type 
Flight  Pattern 
Ha  dial  (Course) 
A 1 1 1 1 u d e 
Hai;i_’r  Block 


Tl,  Primary;  TZ,  Beacon 
D1  , Scan-converted;  DZ , PPI 

R 1,  Tandem;  RZ,  Open  Weave;  F3,  Closed  Weave 
Rl,  050°  ; RZ.  1-40°;  R ),  Z30°;  R4,  3Z0° 

Al,  Z0;  AZ,  14;  A),  8;  A4,  3 thousand  feet 
Ql,  ze  ro-Z5  nmi ; QZ  , Z5-50  mm 

74-8-9 


FIGURE  9.  TEST  DESIGN 


16 


CIRCULAR  PROBABLE  ERROR 


Two  principal  unique  factors  emerge  after  examining  previous  programs  of  radar 
analysis  and  studies  of  aircraft  separation  standards  derived  for  navigation 
systems.  The  first  such  factor  is  that  the  use  of  circular  probable  error 
calculation  is  not  applicable.  In  this  regard,  our  approach  differs  from  that 
of  other  studies  of  radar  error  distribution.  The  two  principal  components 
of  the  horizontal  position  error  of  an  aircraft  are  the  range  error  and  the 
azimuth  error.  To  treat  these  as  the  X and  Y coordinate  errors  around  the 
antenna  can  lead  to  erroneous  calculations. 

The  assumption  in  the  use  of  circular  probable  error  is  that  the  variances  of 
X and  Y are  equal.  The  horizontal  error  around  an  aircraft  radar  target  is 
more  probably  an  ellipse.  However,  if  this  ellipse  is  rotated,  or  moved  360° 
around  the  radar  antenna  in  such  a way  that  the  range  and  azimuth  components 
maintain  their  true  orientation,  then  the  X and  Y coordinates  alternate  between 
being  principally  determined  by  the  range  error  to  being  determined  by  the 
azimuth  error.  Thus,  when  an  aircraft  is  due  north  (or  due  sou^h)  of  the  radar 
antenna,  the  range  error  in  the  displayed  radar  target  position  is  completely 
defined  by  the  Y vector;  whereas,  the  range  error  is  completely  defined  by  the 
length  of  the  X vector  when  the  aircraft  is  due  east  (or  west)  of  the  antenna. 

Moreover,  since  range  error  and  azimuth  error  are  not  completely  independent 
of  each  other,  their  variances  are  not  statistically  independent;  therefore, 
no  simple  combination  of  the  summary  of  range  and  azimuth  errors,  or  summary 
of  the  X and  Y errors,  can  be  made. 

The  second  factor  is  that,  when  two  aircraft  are  within  a few  miles  of  each 
other,  the  range  error  and  the  azimuth  error  of  each  aircraft  are  likely  to 
have  a statistically  significant  positive  correlation  between  them.  Thus, 
the  separation  error  is  not  defined  by  the  overlap  of  the  assumed  independent 
error  distributions  of  the  two  adjacent  aircraft,  but  by  a more  complex 
function  of  the  error  distributions. 

In  the  case  of  an  analogue  radar  system,  when  two  points  in  space  (such  as 
two  aircraft)  approach  convergence  into  one  point  (the  two  aircraft  approach 
minimum  lateral  separation),  the  characteristics  of  their  errors  in  range  and 
azimuth  approach  identity,  represented  by  a positive  correlation  coefficient 
of  1.0.  In  this  study,  to  collect  data  so  that  the  nature  of  this  relation- 
ship is  correctly  interpreted,  it  was  necessary  to  fly  two  aircraft  and  to 
have  them  tracked  by  independent  tracking  radars. 

This  concern  of  positive  correlation  between  errors  is  of  particular  importance 
when  digital  radar  data  is  being  examined.  Since  there  is  the  possibility 
that  the  radar  signals  might  not  be  processed  in  a completely  time-coherent 
fashion,  the  cross-correlation  function  could  be  decreased  when  measured  from 
the  radar  display  scope. 


17 


j 


ANALYSIS 


CONTROL  VARIABLES 


The  basic  analysis  tor  this  program  consisted  of  viewing  an  air  traffic  control 
terminal  radar  system  as  if  it  were  comprised  of  a set  of  six  (6)  independent 
control  variables: 

1.  Radar  types  (T)  — primary  and  secondary  (raw  and  beacon); 

?.  Display  types  (D)  — scan-converted  (RBDE)  and  PPI; 

3.  Flight  patterns  (F)  — tandem,  open  weave,  closed  weave; 

4.  Radials  (R)  — representative  of  bisectors  of  the  four  quadrants  of 
the  sample  airspace,  or  flight  courses  bearing  approximately  50°, 

140°,  230°,  and  320°  from  the  radar  antenna  site; 

5.  Altitudes  (A)  — representative  of  horizontal  sampling  cf  the 
terminal  airspace  at  its  upper  and  lower  boundaries  and  at  two 
intermediate  levels  (approximately  20,  14,  10,  and  3 thousand  feet); 
and 

6.  Range  blocking  (Q)  — from  minimum  range  to  25  nautical  miles 
(approximately),  and  from  25  nautical  miles  to  maximum  range 
(50  nautical  miles). 

The  test  design  was  laid  out  as  a 2^  X 3 X 4^  factorial  experiment,  by  virtue  of 
two  levels  each  for  variables  T,  D,  and  Q,  plus  three  levels  of  F,  and  four 
levels  each  of  R and  A.  The  design  goal  was  to  perform  a set  of  384 
experimental  runs. 

RESPONSE  VARIABLES 


The  responses,  or  system  performance  measures,  were  time  traces  (that  is, 
scan-by-scan  determinations)  for  each  of  two  independently  tracked  aircraft 
of  similar  characteristics  for  each  cell  in  the  design  matrix. 

For  *ac:'  of  the  384  experiments,  or  cells  within  the  design  matrix,  these 
tiro/*  traces  provided  a set  of  primary  responses  as  follows: 


Y^  — the  arithmetic  average  (X)  and  variance  (s^)  of  the  slant  range 
error  for  each  aircraft,  in  nautical  miles  — calculated  on  a 
scan-by-scan  basis  by  subtracting  the  measured  slant  range 
(precision  track)  from  the  displayed  slant  range  (photographed 
track) ; 

— the  arithmetic  average  (X)  and  variance  (s^)  of  the  azimuth  error 
of  each  aircraft,  in  nautical  miles  — calculated  on  a scan-by-scan 
basis  by  subtracting  the  measured  azimuth  (precision  track)  from 
the  displayed  azitauth  (photographed  track). 
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The  Y^  measures  of  range  error  provided  a set  of  four  responses  characterizing 
the  range  error  for  each  cell  within  the  design  matrix: 

Rl  — the  range  error  of  Aircraft  One; 

R2  — the  range  error  of  Aircraft  Two; 

Rl  Var  — the  variance  for  range  error  R^ ; and 

R2  Var  — the  variance  for  range  error  R2 . 

The  measures  of  azimuth  error  were  transformed  from  angular  terms  (degrees) 
to  nautical  miles  so  as  to  provide  a consistent  metric  to  describe  the  response 
measures  and  so  as  to  provide  a linear  form  of  the  data.  These  measures 
provided  a set  of  four  responses  characterizing  the  azimuth  error  for  each 
cell  within  the  design  matrix: 

Az^  — the  azimuth  error  of  Aircraft  One; 

AZ2  — the  azimuth  error  of  Aircraft  Two; 

Az^  Var  — the  variance  of  azimuth  error  Az^ ; and 

A^2  Var  — the  variance  of  azimuth  error  AZ2 . 

SYSTEM  PERFORMANCE  MEASURES 


From  the  eight  response  measures  of  system  performance  just  described,  the 
following  set  of  system  performance  measures  were  derived: 

1.  Separation  error  — the  straight-line  distance  derived  from  the 
position  of  the  two  aircraft  depicted  on  the  display  minus  the  straight-line 
distance  between  the  two  aircraft  as  calculated  from  the  position  determination 
of  the  two  independent  tracking  radars.  This  calculation  was  made  on  a 
scan-by-scan  hasis,  providing  an  average  separation  error  and  variance  for  each 
cell  in  the  design  matrix  (Se  and  Se  Var). 

2.  Correlation  coefficient  between  the  range  error  of  Aircraft  One 
with  the  range  error  of  Aircraft  Two,  on  a per  scan  basis.  This  provided  a 
measure  of  the  independence  of  the  range  error  when  two  aircraft  are  in  geo- 
graphical proximity  to  each  other  (COR  R^  R2). 

3.  Correlation  coefficient  between  the  azimuth  error  of  Aircraft  One 
with  the  azimuth  error  of  Aircraft  Two,  on  a per  scan  basis.  This  provided  a 
measure  of  the  independence  of  the  azimuth  error  when  two  aircraft  are  in 
geographical  proximity  to  each  other  (COR  A^  A2). 
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4.  Correlation  coefficients  between  the  range  error  of  Aircraft  One 
with  the  azimuth  error  of  Aircraft  One,  on  a per  scan  basis,  and  the  same  for 
Aircraft  Two,  These  provided  measures  of  the  independence  of  the  two  components 
which  account  for  the  overall  position  error  of  a single  target  (COR  Rj  A^  and 
COR  R2  A2 ) • 

5.  Multiple  correlation  coefficients  derived  from  the  range  error  and 
the  azimuth  error  of  Aircraft  One  with  separation  error  between  the  two 
aircrait,  on  a per  scan  basis.  Similarly  the  range  error  and  the  azimuth  error 
of  Aircraft  Two  were  regressed  on  the  same  separation  error.  This  response 
measure  provides  information  about  the  dependence  of  separation  error  on  the 
individual  error  values  for  just  one  aircraft;  or,  looking  at  it  another  way, 
this  measure  is  indicative  of  how  well  you  can  predict  the  separation  error 
from  a set  of  range  errors  and  azimuth  errors  c’~rived  for  just  one  aircraft 
(RSQ  13  and  RSQ  24). 

6.  Multiple  correlation  coefficient  derived  from  range  error  and  azimuth 
error  of  Aircraft  One  and  the  range  error  and  azimuth  error  of  Aircraft  Two, 

on  a per  scan  basis.  This  measure  provides  information  about  the  dependence 
of  separation  error  upon  a set  of  values  for  range  error  and  azimuth  error 
when  two  aircraft  are  in  proximity  to  each  other  (RSQ  1234). 

IMBALANCE  IN  NUMBER  OF  OBSERVATIONS 


Some  94  experimental  trials  are  missing  from  the  planned  program  of  384  cells 
in  the  2^  X 3 X 4^  experimental  design.  Some  of  the  cells  are  empty  (or 
effectively  so)  because  of  holes  in  the  radar  coverage,  either  by  the  ASR-4 
airport  surveillance  radar,  or  by  either  of  the  track'  radars.  For  example, 
the  3°  angle  of  elevation  on  the  ASR  antenna  intersects  the  50-nautical-mile 
boundary  of  the  sample  airspace  just  above  the  8,000-foot  level;  and  data  for 
the  3,000-foot  altitude  is  missing  from  mid-range  (25  nautical  miles)  to  that 
boundary,  all  of  range  block  Q2.  Data  missing  because  of  holes  in  the  radar 
coverage  had  no  serious  effect  upon  the  data  results. 

However,  there  are  an  appreciable  number  of  random  missing  cells,  missing 
primarily  because  of  faulty  data  recording  equipment  and/or  human  error.  This 
type  of  missing  data  did  impact  the  analysis  of  variance  in  several  analyses 
where  the  two-way  tables  were  very  seriously  imbalanced. 

For  example,  a cell  in  the  two-way  table  either  had  zero  data,  or  the  number 
of  data  entries  was  less  than  a one-third  to  one-quarter  of  the  average  number 
of  entries  in  the  rest  of  the  table.  Where  this  happens  in  the  series  of  data 
tables  at  the  end  of  this  report  it  will  be  called  to  the  reader's  attention. 


20 


To  illustrate  the  wide  range  in  number  of  observations  by  test  design  data  cell 
the  complete  listing  for  two-way  cells  is  as  follows: 


• i 


NUMBER  OF  OBSERVATIONS  FOR  TWO-WAY  CELLS 
(Combined  N's  for  Phase  1 and  Phase  II) 


D X 

T (Displays 

by  Radar  Mode) 

D X 

R (Displays 

by  Radials)  1 

T1 

T2 

, 

R1 

R2 

R3 

R4  i 

D1 

199 

194 

Dl 

93 

102 

98 

100 

D2 

206 

202 

D2 

104 

101 

102 

101  ! 

D X Q (Displays 

by  Range  Block) 

D X 

F (Displays 

by  Flight  Pattern) 

Q1 

Q2 

FI 

F2 

F3 

D1 

237 

156 

Dl 

134 

134 

125 

J 

D2 

240 

168 

D2 

135 

140 

133 

D X 

A (Displays 

by  Altitude) 

A1 

A2 

A3 

A4 

! 

Dl 

117 

98 

108 

7u 

D2 

112 

98 

125 

73 

j 

T X 

R (Radar  Mode  by 

Radial) 

T X 

Q (Radar  Mode  by 

Range  Block)  ; 

R1 

R2 

R3 

R4 

Q1 

Q2 

; 

T1 

104 

101 

100 

100 

T1 

236 

169 

j 

T2 

93 

102 

100 

101 

T2 

241 

155 

i 

T X 

F (Radar  Mode  by 

Flight  Pattern) 

T X 

A (Radar  Mode  by 

Altitude)  * 

FI 

F2 

F3 

Al 

A2 

A3 

A4 

T1 

135 

140 

130 

T1 

114 

100 

119 

72 

T2 

134 

134 

128 

T2 

115 

96 

114 

71  ; 

R X Q (Radial  by 

Range  Block) 

R X 

F (Radial  by 

Flight  Pattern) 

Q1 

Q2 

FI 

F2 

F3 

R1 

118 

92 

R1 

57 

85 

55 

• 

R2 

120 

83 

R2 

75 

49 

79 

j 

R3 

122 

78 

R3 

62 

75 

63 

j 

R4 

117 

84 

R4 

75 

65 

61 

R X 

A (Radial  by 

Altitude) 

A1 

A2 

A3 

A4 

R1 

46 

59 

44 

48 

R2 

68 

40 

64 

31 

R3 

47 

65 

61 

27 

R4 

68 

32 

64 

37 

Q X 

F (Range  Block  by 

Flight  Pattern) 

Q X 

A (Range  Block  by  Altitude) 

FI 

F2 

F3 

Al 

A2 

A3 

A4 

Q1 

160 

160 

157 

Q1 

118 

112 

120 

127 

Q2 

109 

114 

101 

Q2 

111 

84 

113 

16 

F X A (Flight  Pattern 

by  Altitude) 

A1 

A2 

A3 

A4 

FI 

78 

71 

80 

40 

F2 

87 

68 

69 

50 

F3 

64 

57 

84 

53 

21 
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As  a consequence  of  this  imbalance  in  the  number  of  observation  in  each  cell, 
a standard  orthogonal  analysis  of  the  results  was  not  possible.  A full  non- 
orthogonal  analysis  of  these  data,  taking  into  account  all  main  effects  and 
the  interactions,  proved  insufferably  large.  Also,  there  was  little  interest 
in  or  expectation  that  the  higher  order  interactions  would  be  statistically 
significant. 

MODIFICATION  OF  THE  TEST  DFS ICN 

The  statistical  study  concerns  the  analysis  of  the  basic  three  recorded 
responses  (slant  range  error,  azimuth  erior,  and  separation  error)  for  each 
of  the  290  experiments  (or  cells  in  the  design  matrix)  that  were  eventually 
performed . 

Each  of  the  response  variables,  or  performance  measures,  was  used  for  con- 
ducting an  analysis  of  variance  for  determining  the  effect  of  the  six 
independent  variables  on  the  response  variables.  The  analysis  that  was 
finally  selected  required  the  estimation  of  the  parameters  in  15  separate 
mathematical  models.  Each  model  was  accompanied  by  an  analysis  of  variance 
table,  each  table  in  turn  requiring  the  solution  of  a set  of  normal  equations 
for  nonorthogonal  data.  The  details  of  these  computations  are  explained  in 
appendix  A of  the  Part  11  report. 

The  results  of  these  analyses  were  displayed  by  plotting  the  averages 
associated  with  the  different  treatments  along  with  their  reference,  95-percent 
confidence  "t"  gate  (see  appendix  B of  the  Part  II  report). 

The  15  separate  mathematical  models  resulted  from  the  determination  to  examine 
the  six  main  effects  (independent  control  variables)  and  the  15  two-way  tables 
composed  by  considering  the  six  independent  variables,  two  at  a time. 

The  analysis  selected  was  to  estimate  the  parameters  in  the  mathematical  model 
of  the  form  — 

Yljk  - P+  Pi  + Tj  + o;±i  + eijk 

where:  Yj_jk  ■ observations 

U " grand  mean 

“ effect  of  rows 

T j " effect  of  columns 

C>Tij  *>  effect  of  row  and  column  interaction 

cijk  “ rcsidual  error,  assumed  to  be  NID  (P-0). 

This  model  was  approximate  for  the  six  main  effects  analyses  and  for  each 
of  the  15  possible  two-way  effects. 
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To  say  that  the  model  is  an  approximation  means  that  the  effect  of  each  of 
the  six  control  variables  is  estimated  five  times  as  it  is  paired  with  or 
affected  by  the  other  five  variables.  Rather  than  partial  out  the  effect  of 
all  of  the  five  main  effects,  all  15  two-way  interactions,  a’l  three-way 
interactions,  all  four-way  interactions,  and  the  five-way  interactions,  the 
alternative  scheme  already  described  was  selected.  Furthermore,  because  of 
missing  data,  there  were  instances  when  the  matrix  for  three-way  and  higher 
interactions  had  zero  cells,  making  an  analysis  all  but  impossible.  The 
conclusions  obtained  from  the  model  which  was  used  provide  a conservative 
estimate  of  the  effects  described. 

Since  15  analyses  were  done  for  each  response  variable,  we  obtained  five 
estimates  of  the  significance  of  each  main  effect.  In  our  analyses,  we  will 
occasionally  see  cases  where  main  effects  are  declared  statistically  significant 
in  some  of  the  two-variable  analyses  and  nonsignificant  in  others.  Once  a 
main  effect  is  found  to  he  significant,  we  should  declare  it  significant.  The 
failure  to  be  significant  on  all  occasions  is  due  to  the  presence  of  bias  in 
the  error  mean  square,  this  bias  coming  from  main  effects  not  taken  out  in  the 
two-way  analysis  (that  is,  variables  omitted  from  the  two-way  analysis).  These 
enter  into  the  error  terra,  causing  it  to  be  inflated,  which  results  in  an  under- 
estimation of  the  significance  of  the  main  effect. 

In  determining  whether  real  differences  exist  between  the  treatment  averages 
(for  main  effects),  the  reference  distribution  is  constructed  using  an 
estimate  of  variances  with  the  role  of  the  main  effects  and  all  interactions 
swept  out  (to  the  degree  possible  in  this  nonor thogonal  analysis;.  In  fact, 
we  employed  the  smallest  mean  square  error  obtained  from  all  the  two-way 
analyses  in  constructing  the  reference  distribution.  Even  here,  the  error 
mean  square  is  conservative,  since  it  does  not  exclude  all  effects. 

The  analysis  of  variance  tables  are  unique  in  that  they  give  the  sums  of 
squares  for  each  effect  independent  of  all  other  effects  considered.  Because 
of  the  nonorthogonai  matrix,  the  experimental  designs  of  these  independent 
sums  oi  squares  do  not  add  up  to  the  total  sum  of  squares.  The  computer 
program  used  was  the  F4STAT,  and  the  work  was  performed  at  the  Princeton 
University  Computer  Center. 

REPLICATION,  PHASE  11  DATA 

Since  this  analysis  program  was  of  such  a magnitude  and  comprised  of  such  a 
large  set  of  response  variables  and  dependent  variables,  a partial  replication 
was  conducted.  With  so  many  main  effects  and  two-way  effects  to  examine  for 
the  17  different  response  variables,  it  was  very  probable  that  a reasonable 
number  of  statistically  significant  signals  might  appear  in  the  analysis  by 
pure  chance.  The  replication  (Phase  II)  consisted  of  redoing  the  original 
design  matrix  with  only  two  principal  differences: 
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1.  The  direction  of  flight  of  the  aircraft  as  they  flew  a radial  was 
reversed.  For  example,  for  the  8,000-foot  altitude,  tandem  flight  pattern, 
radial  number  J,  if  the  aircraft  flew  inbound  to  the  antenna  for  the  first  run 
series  (Phase  1),  it  flew  outbound  in  the  corresponding  run  of  the  replication 
series  (Phase  li).  Besides  providing  a replication,  this  reversal  provided 
data  concerning  the  possible  effect  of  approach  velocity  on  the  radar. 

2.  The  second  precision  track;  ..j  : (TA1P.)  was  not  used  and  a 

time/frequency,  air-to-air  ranging  equipment  (ASMS)  was  used  to  determine  the 
measured  aircraft  separation.  This  means  that,  instead  of  the  17  response 
variables  available  in  the  Phase  i pert  ion , only  eight  response  variables  were 
available  in  the  Phase  il  portion. 

The  following  response  variables  were  not  available  from  Phase  II:  mean  range 

error  and  variance  for  Aircraft  Two,  azimuth  error  and  variance  for  Aircraft 
Two,  the  correlation  coefficient  between  the  range  error  of  Aircraft  One  and 
Aircraft  Two,  the  correlation  coefficient  between  the  azimuth  error  of  Aircraft 
One  and  Aircraft  Two,  the  correlation  coefficient  between  the  range  error  and 
the  azimuth  error  of  Aircraft  Two,  the  multiple  correlation  coefficient  of  the 
range  error  and  azimuth  error  of  Aircraft  Two  with  separation  error,  and  the 
multiple  correlation  coefficient  of  the  range  error  and  azimuth  error  of 
Aircraft  One  and  Aircraft  Two  with  separation  error. 

Again  the  basic  design  was  23  X 3 X 4 2 factorial,  only  with  fewer  response 
variables  to  analyze.  Of  the  184  expected  cells  in  this  design  matrix,  only 
221  contained  experimental  results.  Thus,  the  complex  analysis  procedure  was 
replicated  for  Phase  II. 

Included  In  the  analysis  of  this  data  was  an  examination  of  the  distribution  of 
the  three  principal  response  variables: 

1.  The  slant  range  error  of  the  tracked  aircraft, 

2.  The  azimuth  error  of  the  tracked  aircraft,  and 

3.  The  separation  error  between  the  two  test  aircraft. 

POOLED  DATA  - COMBINED  PHASE  I AND  PHASE  li 


Since  this  data  collection  program  resulted  in  a large  data  set  extensively 
sampling  the  terminal  radar  environment,  it  provided  a good  opportunity,  with 
a sufficient  data  base  empirically  derived,  to  analyze  the  nature  of  central 
tendency  and  the  nature  of  the  tails  zz  z'r.z  distribution  of  these  three  response 
variables. 

For  this  report,  all  similar  system  response  measures  were  pooled  and  combined 
into  a single  measure.  For  example,  range  error  of  Aircraft  One  and  range 
error  of  Aircraft  Two  for  the  Phase  I data  sets  were  pooled  with  range  error 
of  Aircraft  One  for  the  Phase  II  data  set  into  a single  expression  of  range 
error  (there  being  no  data  track  for  Aircraft  Two  in  Phase  II  from  which  to 
derive  a separate  measure  of  range  error  for  Aircraft  Two,  Phase  II).  An 
analysis  of  variance  was  then  performed  for  the  pooled  expression. 
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The  reader  can  therefore  expect  some  minor  differences  in  data  interpretation 
(from  the  Part  II  interpretation,  previously  published),  because  this  report 
is  in  fact  based  on  separate  analyses. 

Generally  speaking,  as  the  data  sets  are  pooled,  the  data  should  in  fact 
become  more  homogeneous  and  less  subject  to  extraneous  effects. 

USE  OF  CORRELATION  COEFFICIENTS 


The  analysis  performed  included  the  use  of  correlation  coefficients  end  multiple 
correlation  coefficients  viewed  as  response  variables.  The  correlation  coeffi- 
cient is  a measure  that  is  bounded  by  the  limits  -1<  P <+l.  The  comparison  of 
correlation  coefficients  is  thus  made  awkward,  particularly  in  those  cases 
where  values  of  P are  close  to  the  bounds  , Changes  of  P close  to  the  bounds 
are  not  equivalent  to  equal  changes  in  the  middle  of  the  interval.  For  example, 
change  in  the  correlation  coefficient  of  say  0.50  to  0.51  is  of  much  less 
practical  importance  than  a change  of  0.90  to  0.91,  and  this  change  is  in 
turn  much  less  significant  than  a change  of  0.98  to  0.99. 

The  intent  in  the  use  of  multiple  correlation  coefficients  is  to  maximize  P or 
to  increase  its  value  to  as  close  to  +1.00  as  possible.  Thus,  the  correlation 
measure  is  simply  inappropriate  for  comparisons  or  use  in  an  analysis  of 
variance  program. 

To  avoid  this  handicap  when  comparing  correlation  coefficients,  it  is  usual  to 
transform  the  correlations  into  a measure  that  does  not  have  either  -1  or  +1 
as  its  bounds.  The  accepted  transformation  is  the  one  suggested  by  R.  A.  Fisher, 

i.e.,  Z “ 1/2  In  AtP. . All  analy  «-es  involving  comparisons  between  correlations 
1-P 

as  a function  of  the  experimental  parameters  have  been  performed  in  the 
transformed  scales. 

Some  of  the  basic  sets  of  response  variables  previously  described  were  the 
variances  of  the  range  error,  the  azimuth  error,  and  the  separation  error. 

Because  the  mean  response  was  expected  to  be  positively  correlated  with  the 
variance,  the  logarithmic  transformation  of  the  variance,  when  used  as  a response 
variable  in  the  analysis  of  variance,  was  used.  However,  the  final  reported 
results  and  the  two-way  tables  have  been  re-expressed  xr  terms  of  the  natural 
metric  — variance  or  standard  deviation. 
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RESULTS 


GENERAL 


The  results  will  be  presented  in  terms  of  the  effect  of  the  six  main  control 
variables : 

1.  Radar  mode  (T)  — primary  radar  (Tl),  and  secondary  radar  (T2); 

2.  Displav  type  (D)  — scan-converted,  RBDE  (Dl),  and  PPI  (D2); 

3.  Radials  (R)  — representing  slight  geographical  effects  of  primarily 
over  water  versus  primarily  over  flat  terrain;  050°  (Rl),  140° (R2),  230°  (R3) , 
and  320°(R4),  each  R-block  consisting  of  data  from  two  data  runs,  one  in  each 
direction  of  flight,  for  both  tracked  aircraft  in  Phase  I,  and  for  the  tracked 
aircraft  in  Phase  11; 

4.  Range  blocking  (Q)  — from  minimum  range  (4  to  7 nautical  miles; 

to  approximately  25-nautical-miles  range  or  when  the  range  setting  was  changed 
(Ql),  and  from  25  nautical  miles  to  40-  to  47-nautical-mile  range  where  tracking 
data  ceased  to  be  sufficient  (Q2); 

5.  Altitude  (A)  — 20,000  feet  (Al),  14,000  feet  (A2),  8,000  feet  (A3), 
and  3,000  feet  (A4);  and 

6.  Flight  pattern  (F)  — tandem  (FI),  open  weave  (F2),  and  closed  weave 
(F3)  — representing  the  different  angular  relationships  of  two  aircraft  as 
they  converge  and  diverge  in  close  proximity  to  each  other. 

Because  of  the  quantity  and  details  of  the  whole  analysis  of  this  project, 
this  report  addresses  itself  to  a summary  and  analysis  of  the  pooled  data  set. 

For  a more  detailed  presentation,  including  tables  of  data  results  prior  to 
pooling,  the  reader  should  refer  to  Part  II  of  this  report,  published  separately. 

The  discussion  of  the  results  will  center  principally  on  the  data  in  tables  I, 

II,  and  III  in  this  report.  Only  those  differences  that  were  assessed  as  being 
statistically  significant  for  the  main  effects  and  for  the  two-way  interactions 
will  be  presented  in  this  discourse.  However,  the  reader  may  determine  the 
exact  level  of  all  effects  by  examining  Part  II. 

INTERPRETATION  OF  STATISTICAL  SIGNIFICANCE  


For  purposes  of  discussion,  a "true"  difference,  or  statistically  significant 
difference,  between  two  or  more  conditions  (subsets)  is  said  to  exist  if  the 
statistical  significance  in  the  probability  level  is  .05  or  smaller.  The 
determination  of  the  existence  of  significant  differences  is  made  on  the  basis 
of  comparing  the  means  of  the  responses  for  that  set  of  conditions.  For 
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comparing  k means,  we  are  attracted  to  the  k (k-l)/2  possible  differences.  The 
Student’s  "t"  reference  distribution  approach  (see  appendix  B in  Part  II,  under 
separate  cover)  provides  a convenient  device  for  making  these  many  comparisons. 

HOW  TO  READ  THE  TABLES 


The  tables  need  some  explanation.  To  assist  the  reader  in  this  regard,  the 
following  statement  is  provided. 

Table  I presents  an  "overview"  of  all  the  tables  in  the  table  II  series. 

Table  II  indicates  which  of  the  system  control  variables  (D,  T,  R,  Q,  F,  A — 
display  type,  radar  mode,  radial,  range  block,  flight  pattern,  altitude)  sta- 
tistically affected  the  system  response  measures  (position  error,  separation 
error,  etc.). 

Reading  across  table  I,  the  first  line  of  tabular  entries  informs  us  that  the 
effect  of  the  control  variable  D (radar  display  type)  on  the  magnitudes  of  the 
system  response  measures  was  (**  in  columns  2,  3,  4,  6,  7,  8,  9,  10,  11,  12) 
statistically  significant  for  mean  position  error,  for  position  error  variance, 
for  mean  separation  error,  for  mean  range  error,  for  range  error  variance,  for 
mean  azimuth  error,  for  azimuth  error  variance,  for  correlations  between  range 
error  and  azimuth  error  of  aircraft  (tracked),  for  correlations  of  range  error 
Aircraft  One  to  range  error  Aircraft  Two,  and  to  correlations  between  azimuth 
error  Aircraft  One  to  azimuth  error  Aircraft  Two.  Similarly  this  first  line 
of  tabular  entries  informs  us  that  the  effect  of  control  variable  D on  magnitudes 
of  system  response  measures  was  (ns  in  columns  5,  13,  14)  not  significant  for 
separation  error  variance,  nor  for  multiple  correlations  between  range  errors 
(of  both  aircraft  independently)  and  azimuth  errors  (of  both  aircraft  independ- 
ently) regressed  on  separation  error  (between  the  two  aircraft). 

Reading  down  the  fifth  column,  the  effects  of  each  of  the  other  control  variables 
in  turn  on  magnitudes  of  separation  error  variance  (s2)  were  statistically 
significant  (**) ; but  for  all  two-way  interactions  (DXT,  DXR...FXA),  the  effects 
on  separation  error  variance  were  not  statistically  significant  (ns). 

Table  II  (series)  should  be  read  across  the  rows,  not  down  the  columns.  The 

left-hand  column  reading  down,  D,  T,  R,  Q,  F,  A FA,  lists  the  letter 

designators  for  main  effects  and  two-way  effects.  The  values  across  the  rows 
show  the  significance  level  (probability)  extracted  from  the  analysis  of  variance. 

There  are  five  values  for  each  main  effect  because  of  the  fact  that  it  was 
estimated  every  time  a two-wav  effect  was  estimated.  Thus,  reading  from 
table  II-l,  we  see  that  the  D main  effect  (display  main  effect)  was  statistically 
significant,  and  greater  than  the  .000X  probability  level;  the  T (radar  mode) 
main  effect  was  not  statistically  significant,  as  indicated  by  .798,  .806,  .634, 
.770,  and  .561  levels  respectively,  through  the  FXA  (flight  pattern  by  altitude) 
effect  being  not  statistically  significant  at  the  .746  level.  The  reader  is 
enjoined  to  examine  table  III  to  find  the  corresponding  magnitude  of  the 
difference  between  the  appropriate  means  that  resulted  in  the  probabilities  in 
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table  II.  For  example,  table  11-1  indicates  a significant  difference  between 
displays  for  aircraft  position  error  (.000X),  and  table  I I I — 1 shows  that  the 
RBDE  displays  (Dl)  had  a mean  position  error  of  0.602  nautical  miles,  whereas 
the  PPI  displays  (D2)  had  a mean  position  error  of  0.762  nautical  miles.  This 
difference  of  0.160  nautical  miles  was  very  statistically  significant,  with  the 
RBDE  displays  having  the  smaller  mean  position  error. 

APPLICATION  OF  THE  RESULTS 


The  reader  should  be  aware  that  the  results  reported  here  are  not  exactly 
the  same  as  summary  results  published  in  the  Part  II  report,  even  thougn 
the  same  data  were  used  for  both  reports.  The  results  in  Part  II  are  derived 
from  analyses  of  three  independent  data  sets  and  a comparison/summary  thereof. 

The  results  in  this  report  are  derived  from  a statistical  pooling  of  these 
three  sets  of  data,  and  the  analyses  of  variances  in  this  report  were  calculated 
on  this  pooled  data.  This  should  result  in  a more  homogeneous  and  normal 
distribution  of  the  subsets  of  data.  However,  where  the  analysis  of  variance 
matrices  had  an  imbalance  in  the  number  of  entries,  this  would  still  hold  true 
(e.g.,  in  the  QXA  — Range  Block  by  Altitude  analysis,  the  second  range  block 
and  minimum  altitude  data  set  still  has  an  abnormally  small  number  of  entries 
as  contrasted  to  the  rest  of  the  matrix) . 

This  report  is  addressed  to  a statistical  characterization  of  the  response 
variables  (i.e.,  range  error  or  azimuth  error  for  each  aircraft,  position  error 
per  aircraft,  separation  error  between  the  two  aircraft,  and  the  related  variances, 
correlation  coefficients  and  multiple  correlation  coefficients)  cf  a typical 
ASR-4  system.  ("Typical"  implies  representative  of  the  population  of  airport 
surveillance  radar  systems  of  ASR-4  type  which  were  in  operational  service  at 
field  facilities  of  FAA  air  traffic  control.) 

This  report  does  not  attempt,  nor  does  the  project  effort  as  a whole,  to 
determine  any  cause  and  effect  of  the  magnitude  of  the  responsive  variables, 
nor  of  their  relationships.  The  writers  are  fully  aware  that  some  of  the  results 
were  determined  by  the  specific  design  and/or  engineering  status  of  the  system, 
and  that  if  these  were  changed,  some  of  the  results  might  be  affected.  Thus, 
the  results  are  relative  to  the  specific  system  operating  conditions.  There- 
fore, any  broad  generalizations  to  another  population  of  radar  systems  should 
be  made  only  with  due  caution. 

While,  from  a viewpoint  of  correct  experimental  design,  one  vrould  seek  a specific 
evaluation  of  each  radar  system  (such  as  ASR-5  and  ASR-7) , certain  generaliza- 
tions from  this  study  can  be  expected  to  apply.  Within  the  family  of  airport 
surveillance  radars  applied  in  the  federal  air  traffic  control  system,  design 
changes  have  been  most  conservative  with  respect  to  factors  affecting  target 
position  and  separation.  Mainly,  design  changes  have  affected  quality  of 
detection  and  control  of  noise. 
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It  is  anticipated  that  the  effects  due  to  the  primary  control  variables  (type 
of  display  system,  radar  mode,  target  bearing,  range  blocking,  flight  pattern, 
and  target  altitude)  are  generalizaL le  to  radars  other  than  ASR-4 : however,  the 
absolute  magnitudes  of  range  error  and  azimuth  error,  or  their  products,  are  not 
generalizable.  Thus,  we  would  expect  the  relative  difference  of  a response 
variable,  say  range  error  for  range  block  1 versus  range  error  for  range  block  2, 
in  all  likelihood  would  be  generalizable,  but  the  absolute  magnitude  of  the  range 
error,  in  this  case  0,0567  nautical  miles  for  range  block  1,  is  likely  to  vary 
from  one  system  test  to  another. 

Furthermore,  the  introduction  of  digital  processing  of  radar  signals  is  such  that 
generalization  from  this  study  of  broadband  radar  to  digitized,  narrowband  radar 
systems  is  not  expected  to  be  valid,  and  specific  evaluations  of  those  systems 
should  be  conducted. 

ANALYSIS  OF  MAIN  EFFF.CTS 

DISPLAYS  (D)  — SCAN-CONVERTED  (Dl)  AND  PPI  (D2) . The  data  indicates  that  the 
PPI  displays  exhibit  a statistically  larger  position  error  and  position  error 
variance  than  did  the  RBDE  (scan-converted)  displays.  Also,  the  PPI  displays 
exhibit  a statistically  larger  separation  error  than  did  the  RBDE's.  Since 
the  processed  radar  signals  feeding  these  two  sets  of  displays  were  essentially 
equivalent,  the  RBDE's  could  be  considered  a preferred  display  for  determina- 
tions of  both  position  error  and  separation  error,  inasmuch  as  a minimum  error 
in  these  respective  variables  is  desirable. 

The  data  indicates  that  the  PPI  displays  exhibited  a statistically  larger  mean 
range  error  and  azimuth  error  than  the  RBDE  displays:  however,  only  the  range 
error  variance  was  significant,  with  the  PPI  again  having  the  larger  range 
error  variance. 

The  data  shows  that  the  RBDE  tended  to  display  the  range  of  the  aircraft  as 
less  than  the  true  range;  whereas,  the  PPI  tended  to  display  the  range  as 
greater  than  the  true  range. 

The  mean  azimuth  error  for  the  RBDE's  was,  for  all  Intents  and  purposes,  zero; 
whereas,  the  PPI  tended  to  displace  the  target  towards  the  radar  leading  edge 
or  at  a greater  angle  than  true  azimuth.  Thus,  the  indication  is  that  the 
RBDE  displays  performed  with  a minimum  range  and  azimuth  error. 

The  correlation  coefficients  between  (1)  the  range  error  of  two  aircraft  in 
proximity  to  each  other,  (2)  the  azimuth  error  of  two  aircraft  in  proximity 
to  each  other,  and  (3)  the  range  error  and  azimuth  error  of  a single  aircraft 
all  were  significantly  larger  for  the  PPI's  than  for  the  RBDE's.  This  Indicates 
that  the  PPI  displays  tended  to  preserve  the  relative  spatial  relationship 
between  two  adjacent  targets  better  than  did  the  RBDE  displays.  That  is,  when 
an  aircraft  tended  to  vary  from  its  true  position  on  a PPI,  an  aircraft  target 
in  proximity  to  the  first  target  tended  to  vary  in  the  same  direction  and  mag- 
nitude. Furthermore,  the  vithin-target  consistency  1(1. e. . the  relative  rela- 
tionship between  the  magnitude  of  a target's  range  error  and  azimuth  error 
tended  to  vary  in  a monotonic  manner)  was  better  preserved  on  a PPI  display 
than  on  an  RBDE  display. 
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RADAR  MODE  (T)  — PRIMARY  RADAR  (Tl) , AND  BEACON  (T2) . The  radar  mode  selected, 
raw  radar  or  beacon  (primary  and  secondary  radar  respectively),  did  not  appear 
to  significantly  affect  the  magnitude  of  position  error,  position  error  variance, 
or  separation  error,  although  variance  of  the  separation  error  was  significantly 
larger  for  the  beacon  rad^r  mode.  This  means,  for  the  beacon  radar  mode,  that 
for  95  percent  of  the  time,  the  aircraft  could  be  expected  to  be  between  0.292 
nautical  miles  less  than,  to  0.436  nautical  miles  more  than  actual  separation 
[mean  error  (0.072  nautical  miles)  +1.96  s y' . 0346] . For  comparison,  the 
95-percent  confidence  limit  for  the  primary  target  is  -0.224  nautical  miles  to 
+0.324  nautical  miles. 

Neither  radar  mode  evidenced  significantly  different  mean  range  error  or  range 
error  variance,  although  the  primary  radar  indicated  a significantly  greater 
mean  azimuth  error,  with  the  beacon  radar  having  the  larger  azimuth  error 
variance . 

The  data  indicates  that  the  primary  radar  exhibited  a significantly  larger 
positive  correlation  coefficient  between  range  error  and  azimuth  error,  range 
error  and  range  error,  and  azimuth  error  and  azimuth  error  than  did  the  beacon 
radar. 

RADIALS  (R) . Radials  represented  more  of  a random  variable  of  the  environment 
which  we  could  treat  as  a control  variable  and  determine  some  effects  on  the 
system  response  variables.  In  general,  the  radials  represented  the  effect  of 
flying  (1)  almost  exclusively  over  the  ocean,  (2)  almost  exclusively  over 
flat  terrain,  and  (3)  over  surface  of  mixed  character  between  marsh,  water, 
and  flat  terrain. 

For  the  radials  variable,  there  was  a very  significant  effect  on  the  mean 
and  variance  of  the  position  error  and  on  the  mean  and  variance  of  the  separation 
error.  For  interpretation,  however,  no  clear  cut  effect  can  be  attributed  to 
the  over-land  condition  versus  over  water.  Thus  we  conclude  merely  that  the 
data  results  substantiate  that  terrain  surrounding  a radar  i te  apparently 
affects  radar  target  position. 

The  data  indicates  that  the  radials  had  a significant  effect  upon  the  mean  range 
error,  and,  since  the  order  of  the  mean  range  error  by  radial  shifted  for  the 
various  data  collection  phases,  it  suggests  thvt  a possible  mixture  of  topographic 
effect  and  weather  effect  occurred.  There  VdS  a tendency  for  the  radials  over 
marsh  and  bayshore  (R1  and  R3)  to  have  a larger  mean  range  error  than  those  over 
ocean  (R2)  and  flat  terrain  (R4) . The  variability  of  the  range  error  was  not 
significantly  affected. 

The  only  correlation  coefficient  that  had  a significant  radial  effect  was  the 
simple  correlation  between  the  range  errors  of  two  adjacent  aircraft  targets. 
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RANGE  BLOCKING  (Q) . Ql,  MINIMUM  RANGE  TO  ABOUT  25  NAUTICAL  MILES,  AND 
Q2,  25  NAUTICAL  MILES  TO  MAXIMUM  RANGE.  This  control  variable  represented 
a mixture  of  two  parameters,  distance  from  the  radar  antenna,  and  distance 
from  the  center  of  the  display.  The  minimum  observed  range  was  from  4 to  7 
nautical  miles,  and  the  maximum  observed  range  varied  from  40  to  47  nautical 
miles. 

The  data  indicates  that  the  range  blocking  had  a significant  effect  upon  the 
mean  range  error,  with  Ql,  the  range  block  closer  to  the  antenna,  as  expected, 
having  the  smaller  error.  No  effect  on  the  range  error  variability  was 
observed . 

The  mean  azimuth  error  and  the  variance  of  the  azimuth  error  were  significantly 
affected  by  the  range  blocking,  again  with  the  inner  range  block,  Ql,  having 
the  smaller  mean  and  variance. 

The  data  indicates  a significantly  smaller  mean  position  error  and  mean 
separation  error,  with  correspondingly  smaller  variances,  for  the  Ql  range 
blocks.  When  an  aircraft  is  within  25  nautical  miles  of  the  radar  antenna, 
its  displayed  position  can  be  expected  to  be  (on  the  average)  0.525  nautical 
miles  away  from  its  true  position;  and  when  an  aircraft  is  farther  than 
25  nautical  miles  from  the  radar  antenna,  its  radar  target  can  be  expected 
to  be  0.917  nautical  miles  (on  the  average)  from  its  true  position.  When 
the  two  aircraft  were  displayed  as  3 nautical  miles  apart,  they  were  (on 
the  average)  2.957  nautical  miles  apart  in  range  block  Ql  and  2.912  nautical 
miles  apart  in  range  block  Q2.  While  true  separation  was  slightly  less  than 
displayed  separation,  the  difference  appears  to  be  below  the  threshold  of 
discernibility  to  the  eyes  of  a radar  controller  using  displays  of  this  scale. 

Since  the  means  and  variances  for  these  response  variables  were  significantly 
different  for  Ql  and  Q2,  the  following  is  illustrative  of  the  data: 

1.  Position  error  (given  the  true  position  of  an  aircraft)  — 

Ql  displayed  position  average  error  = 0.525  nautical  miles, 

Q2  displayed  position  average  error  = 0.917  nautical  miles; 

Probable  variability  of  the  average  displayed  position  error 
(99  percent  of  the  time)  — 

Ql  * -0.265  to  +1.315  nautical  miles, 

Q2  » -0.245  to  +2.079  nautical  miles: 

2.  Separation  error  (given  that  3 nautical  m„les  is  the  true  separation)  — 

Ql  average  displayed  separation  = 2.957  nautical  miles, 

Q2  average  displayed  separation  = 2.912  nautical  miles; 

Probable  variability  of  the  average  displayed  separation 
(99  percent  of  the  time)  — 

Ql  = 2.597  to  3.317  nautical  miles, 

Q2  = 2.408  to  3.417  nautical  miles. 
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The  difference  in  variances  between  Q1  and  Q2  is  apparent  when  the  respective 
data  results  are  substituted  into  the  expression 

X + t }/~a 2*.  where  t = 2.576  for  the  99-percent  confidence  interval: 

Most  probable  (99-percent  confidence)  variability  of  the  position  error  mean  — 
Q1  = 0.525  +2.576  t/,0941 

Q2  = 0.917  +2.576  »/.2035  ; 

Most  probable  (99-percent  confidence)  variability  of  the  separation  error 

mean  — 

Q1  = 2.957  +2.576  /01?5 

Q2  * 2.912  +2.576  y. 0384 

The  correlation  coefficient  between  the  range  error  of  an  aircraft  ane  the 
azimuth  error  of  that  aircraft  was  significant,  as  was  the  cross  correlation 
between  the  azimuth  errors  of  two  adjacent  aircraft. 

The  multiple  correlation  coefficient  of  the  two  range  errors  and  the  two 
azimuth  errors  on  separation  error  was  significantly  larger  for  range  block  Q2, 
the  outer  range  block. 

ALTITUDE  (A)  — 20,000  (Al) , 14,000  (A2) , 8,000  (A3),  3,000  (A4) . The  data 
indicates  that  the  altitude  of  the  aircraft  had  a very  significant  effect  upon 
the  mean  position  error,  the  mean  separation  error,  and  their  associated 
variances.  The  effect  was  generally  in  the  expected  direction-  that  is, 
maximum  mean  error  and  variance  associated  with  maximum  altitude  (Al) , and 
minimum  mean  error  and  variance  associated  with  minimum  altitude  (A4) . However, 
the  function  was  not  as  smooth  as  desired. 

The  mean  range  error  and  associated  variance  were  significantly  affected  by 
the  altitude.  Again,  the  magnitude  of  the  error  was  in  the  expected  direction, 
but  the  function  was  not  as  smooth  as  expected. 

The  only  other  variable  significantly  affected  by  the  control  variable, 
altitude,  was  the  simple  correlation  coefficient  between  range  error  and 
azimuth  error. 

FLIGHT  PATTERN  (F)  — TANDEM  (FI),  OPEN  WEAVE  (F2) , AND  CLOSED  WEAVE  (F3) . 

These  three  flight  patterns  were  included  in  the  test  design  principally  to 
provide  a random  sampling  of  angular  convergence  and  divergence  of  aircraft. 
Since  data  results  included  a significant  effect  by  this  (F)  control  variable 
upon  a number  of  response  variables,  we  feel  obligated  to  present  these  results. 
Since  the  design  intent  was  to  include  flight  pattern  as  a random  variable,  just 
as  radar  propagation  effects  and  environmental  effects,  which  would  all  be 
included  in  the  error  term  when  testing  for  significant  main  effects,  ic  was 
so  included  here. 
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The  mean  separation  error  and  its  associated  variance  were  very  significant, 
with  the  tandem  flight  pattern  having  the  significantly  larger  separation 
error.  This  is  not  surprising,  since  the  separation  between  the  test  aircraft 
in  the  tandem  flight  pattern  was  determined  principally  by  range  error,  which 
was  significantly  larger  than  azimuth  error.  Correspondingly,  the  separation 
between  the  test  aircraft  in  the  open  weave  and  closed  weave  flight  patterns 
was  principally  determined  by  the  azimuth  component  of  the  separation  vector; 
and  the  weave  patterns  had  the  smallet  separation  error.  The  position  error 
variance  and  the  separation  errs,  variance  also  were  significant,  however  no 
clear-cut  relationship  existed  here. 

The  data  indicates  that  the  correlation  coefficient  between  the  range  error 
of  the  two  aircraft  and  the  multiple  correlation  coefficient  of  separation 
error  on  the  two  range  errors  and  two  azimuth  errors  were  significantly  affected 
by  the  flight  pattern  control  variable.  Again,  no  consistent  effect  is 
observable . 

ANALYSIS  OF  TWO-WAY  INTERACTION'S 

So  far  in  the  presentation  of  results,  only  the  statistically  significant 
results  due  to  the  main  effects  have  been  presented.  Thus,  we  have  stated 
that  six  control  variables  were  employed  in  the  senes  of  experiments,  and  that 
each  control  variable  had  at  least  two  treatment  levels.  For  example,  the 
treatment  levels  for  the  control  variable  D (displays)  were  scan-converted  RBDE 
(Dl)  and  PPI  (D2) . When  a main  effect  was  declared  statistically  significant, 
this  meant  that  changing  of  the  level  of  the  variable  significantly  affected 
the  response. 

Now  the  significance  of  any  tvc-way  interactions  will  be  presented.  Declaring 
a two-way  interaction  to  be  sign.ficant  means  that  a change  in  the  level  of  one 
variable  had  an  effect  upon  a second  variable  even  though  the  level  of  the 
second  variable  did  not  change,  o.-  it  means  that  one  of  the  levels  of  a specific 
variable,  when  in  the  presence  of  just  one  level  of  a second  variable,  resulted 
in  a change  in  the  response  such  that  no  simple  additive  effect  can  account  for 
the  change. 

Since  only  a few  of  the  two-way  interactions  have  any  operational  utility 
associated  with  them,  these  will  be  singled  out  for  discussion. 

The  Display  by  Radar  Mode  (DXT)  is  of  some  interest  since,  if  one  display 
type  and  one  radar  mode  when  combined  performed  significantly  poorer  or 
better  than  the  averages  for  the  other  two-way  combinations,  this  should  be 
of  some  interest  to  operational  personnel.  The  data  indicates  no  significant 
preference  (either  to  accept  or  to  reject)  for  any  of  the  four  possible 
combinations  (Dl  X Tl,  Dl  X T2,  D2  X Tl,  D2  X T2) . 

The  Radar  Mode  by  Range  Block  (TXQ)  and  Radar  Mode  by  Altitude  (TXA)  are  of 
interest  in  that,  if  a particular  range  block  or  altitude  favored  a radar  mode, 
such  information  would  be  useful  in  system  planning.  Neither  of  these  two-way 
interactions  significantly  affected  any  of  the  response  variables. 
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The  only  other  two-way  Interaction  of  operational  importance  is  Range  Block  by 
Altitude  (QXA) . Again,  no  two-way  combination  of  range  block  and  altitude  of 
the  eight  possible  combinations  (Q1  X Al,  Q1  X A2,  Q1  X A3,  Q1  X A4,  Q2  X Al, 
Q2  X A2,  Q2  X A3,  Q2  X A4)  had  a significant  effect  upon  any  of  the  response 
variables . 

ANALYSIS  OF  RESPONSE  VARIABLES 


The  response  variables  have  been  partially  discussed  from  the  standpoint  of 
how  they  were  affected  by  the  control  variables.  However,  it  would  be  useful 
to  discuss  them  by  themselves. 

(1)  POSITION  ERROR.  The  position  error  as  presented  in  the  tables  is 
defined  in  terms  of  the  range  and  azimuth  errors  on  a radar  scan  by  radar 

scan  basis,  i.e.,  PE  = ^ RE^  + AE^ 


position  error  = 


y/  range  error^  + azimuth  error^ 


As  such,  it  is  always  computed  as  being  positive  in  sign,  regardless  of  the 
relative  signs  of  the  range  and  azimuth  errors. 

The  distribution  of  the  position  errors  has  therefore  been  "folded"  around 
zero,  as  if  the  absolute  value  of  a normally  distributed  variable  had  been 
used.  In  order  to  unfold  the  distribution  and  estimate  the  "true"  character- 
istics of  the  position  error,  it  was  necessary  to  use  the  methods  of  Johnson 
and  Leone  (reference  3)  for  estimating  the  ratio  parameter  of  the  underlying 
mean  to  the  standard  deviation. 

For  discussion  purposes,  the  unfolded  estimates  of  the  mean  position  error  and 
variance  are: 

mean  position  error  = -0.1764  nautical  miles 

position  error  variance  = 0.9784  nautical  miles 

This  compares  to  the  "folded"  estimates  of  (see  table  II) : 

mean  position  error  = 0.6835  nautical  miles 

position  error  variance  = 0.1383  nautical  miles 

Either  of  these  calculations  is  analogous  to  looking  at  the  position  error 
as  though  it  were  a circular  probable  error. 
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As  seen  from  previous  discussion  concerning  the  range  error  and  the  azimuth 
error  with  their  concomitant  cross-correlation  coefficients,  the  probability 
density  function  is  not  circular,  but  an  ellipse.  Therefore,  the  true  position 
error  is  defined  by  the  elliptical  probable  error  distribution  for  the  combined 
range  error  and  azimuth  error  (figures  10  and  11  for  Q1  and  Q2  respectively). 

The  center  of  the  ellipses  was  established  as  the  mean  range  error  and  the 
mean  azimuth  error.  The  contour  of  the  ellipse  is  the  95-percent  boundary 
of  the  mean  deviation  of  the  range  and  azimuth  error.  The  tilting  of  the 
ellipse  is  due  to  the  fact  that  the  instantaneous  range  and  azimuth  values 
were  correlated  with  each  other. 

The  reader  should  be  cautioned  about  extrapolating  from  these  ellipses  any 
inferences  concerning  any  expected  overlap  of  adjacent  targets  because  at  any 
time  there  is  a significant  positive  cross-correlation  between  the  range  error 
and  azimuth  error  of  the  two  depicted  targets.  The  question  of  probable 
overlap  for  adjacent  targets  can  be  addressed  by  examining  the  separation 
error  data. 

(2)  SEPARATION’  ERROR.  The  mean  separation  error  of  0.061  nautical  miles,  with 
an  average  standard  deviation  of  0.164  nautical  miles  (variance  = 0.027  nautical 
miles),  indicates  that  displayed  separation,  on  the  average,  was  greater  than 
the  true  separation  of  two  adjacent  aircraft  in  close  proximity  to  each  other. 
The  maximum  deviation  around  the  mean  was  -0.94  nautical  miles  to  +0.98  nautical 
miles  (see  Part  II  report,  under  separate  cover,  tables  V-3  and  VI-3  in  the 
addenda).  This  means  that,  for  the  separation  range  under  consideration  during 
this  study,  when  aircraft  radar  targets  were  displayed  at  3 nautical  miles  in 
separation,  they  were  never  less  than  1.959  nautical  miles,  nor  more  than 
3.879  nautical  miles  from  each  other  (lateral  or  longitudinal  separation) . This 
is  derived  from  somewhere  in  the  neighborhood  of  30  thousand  observations,  and 
for  radar  targets  that  were  resolved  by  the  ASP-4,  and  as  measured  from  the 
center  of  the  radar  blips  (targets)  whether  in  primary  mode  or  secondary  radar 
mode. 

Another  point  to  be  discussed  here  is  the  cumulative  probability  density 
function  of  the  separation  error  when  plotted  on  double-exponential  paper.  The 
data  evidences  a straight  line,  demonstrating  that  the  data  is  NOT  normally 
distributed.  The  exponential  plot  (see  figure  12)  indicates  that  the  data 
is  normal  for  the  central  tendency,  but  that  the  tails  of  the  distribution  lock 
very  much  like  an  exponential  distribution.  What  this  means  is  that  there 
were  many  more  large  excursions,  or  data  points  at  the  extremes  of  the 
distribution,  than  can  be  accounted  for  by  a normal  distribution. 

The  magnitude  of  the  separation  error  was  clearly  dependent  upon  the  condition 
of  the  following  control  variables:  D,  R,  Q,  A,  and  F;  or  display  type,  radial, 

range  block,  altitude,  and  flight  pattern,  respectively.  These  have  been 
discussed  elsewhere  in  this  report. 
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PROBABLE  DISTRIBUTION  OF  RELATIVE  POSITION  ERROR  - RANGE  BLOCK  Q2 


A further  breakdown  of  the  data  is  of  operational  interest  here:  the  question 
of  what  is  the  relative  magnitude  of  the  separation  error  when  the  aircraft 
are  within  approximately  25  nautical  miles  of  the  radar  antenna  and  at 
an  altitude  below  10,000  feet,  as  compared  to  being  at  a range  greater  than 
25  nautical  miles  from  the  radar  antenna  at  an  altitude  of  10,000  feet  or 
higher.  The  following  data  is  calculated  from  the  QXA  Averages  data  (Range 
Block  by  Altitude),  table  II 1—14 : 

(a)  Ql/Al,  A2;  Q2/A1,  A2,  A3,  A4;  wt.avg.Se 

— all  airspace  within  50  nautical 
miles  and  above  10,000  feet; 
and 

all  airspace  from  surface  to  wt.avg.SeVar 

20,000  feet,  and  beyond  25  nautical 
miles. 

(b)  Q1/A3,  A4;  wt.avg.Se 

— airspace  below  10,000  feet 
and  within  approx.  25  nautical 
miles . 

wt .avg. SeVar 

(3)  RANGE  ERROR.  The  mean  range  error  of  0.232  nautical  miles,  with  an  average 
standard  deviation  of  0.308  nautical  miles  (variance  - 0.0951  nautical  miles) 
indicates  that  the  true  slant  range  of  the  aircraft  tended  to  be  significantly 
closer  to  the  radar  antenna  than  was  the  displayed  range  of  the  aircraft  radar 
target. 

The  maximum  range  error  observed  for  all  data  (approximately  45,000  observations) 
was  a target  displayed  at  3.052  nautical  miles  greater  than  true  slant  range; 
and  the  minimum  range  error  was  a target  displayed  2.608  nautical  miles  closer 
to  the  radar  antenna  than  the  true  slant  range. 

The  greatest  variability  between  maximum  and  minimum  within  one  test  run 
(between  20  and  25  minutes  flight  time,  outbound  from  the  radar  antenna  on  a 
radial)  was  2.590  nautical  miles.  This  was  not  characterized  by  purely  random 
error,  but  had  a time-dependent  characteristic  to  it;  i.e.,  the  range  error 
tended  to  get  larger  as  the  aircraft  proceeded  away  from  the  antenna,  or,  vice 
versa,  the  range  error  tended  to  get  smaller  as  the  aircraft  approached  the 
antenna.  This  is  expected,  since  slant  range  error  increases  as  ground  range 
increases . 

Furthermore,  the  range  error  was  highly  correlated  with  the  range  blocking 
control  variable  (Q) , as  indicated  by  the  VERY  significant  F ratio  (p<  .00001) 
for  the  Q variable  (average  range  error  Q1  = 0.057,  and  Q2  * 0.491). 


■ 0.0243  nautical  miles 


* 0.0165  nautical  miles 


* 0.0813  nautical  miles 


* 0.0324  nautical  miles 
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The  relative  magnitude  of  the  range  error  of  two  aircraft  in  proximity  to  each 
other  tended  to  be  very  highly  correlated.  For  example,  the  scan-by-scan 
cross-correlation  coefficient  was  .763  (COR  Range  error:  Range  error).  The 
relative  magnitude  of  the  range  error  was  also  positively  correlated  with  the 
relative  magnitude  of  the  azimuth  error  on  a scan-by-scan  basis.  For  example, 
the  correlation  of  range  error  to  azimuth  error  = .486  (COR  Range  error:  Azimuth 
error) . 

(4)  AZIMUTH  ERROR.  The  mean  azimuth  error  of  0.119  r.  '1  miles,  with  a 

standard  deviation  of  0.167  nautical  miles  (variance  30  nautical  miles) 

indicates  that  the  true  azimuth  of  the  aircraft  ten  to  be  biased  towards 
the  radar  leading  edge.  For  purposes  of  this  study,  the  term  radar  leading 
edge  refers  to  that  portion  of  the  radar  target  from  which  the  first  radar 
returns  are  received,  and  the  term  radar  trailing  edge  refers  to  that  portion 
of  the  target  from  which  the  last  radar  returns  (for  each  sweep  of  the  antenna) 
are  received.  Since  the  antenna  rotation  is  displayed  as  clockwise  from  north, 
the  leading  edge  of  the  target  has  a smaller  azimuth  angle  than  the  trailing 
edge.  It  should  be  noted  that  such  features  of  the  displayed  target  (data 
film)  were  observed  and  declared  as  perceived  by  a human  operator,  and  that 
the  Telereadex  operator  was  instructed  to  declare  the  aircraft  position  to 

be  in  the  geometric  center  of  the  displayed  target,  or  the  perceived  point  of 
maximum  target  density. 

The  maximum  azimuth  deviation  towards  the  leading  edge,  for  approximately  45,000 
observations,  was  2.821  nautical  miles,  and  towards  the  target  trailing  edge  was 
2.079  nautical  miles.  This  was  characterized  by  a time -dependent  or  range- 
dependent  error;  that  is,  the  magnitude  of  the  azimuth  error  tended  to  increase 
as  the  aircraft  range  increased. 

The  magnitude  of  the  azimuth  error  was  very  significantly  correlated  with  the 
range  of  the  aircraft,  as  indicated  by  the  very  significant  F (p<  .0001)  for  the 
Q variable  (average  azimuth  error  Q1  = 0.054  nautical  miles,  and  Q2  - 0.216 
nautical  miles) . 

The  relative  magnitude  of  the  azimuth  error  for  two  aircraft  in  proximity  to 
each  other  was  significantly  correlated  (COR  Azimuth  error:  Azimuth  error  = .357). 
This  is  not  a sufficiently  large  correlation  to  indicate  a strong  predictive 
relationship . 

(5)  MULTIPLE-CORRELATION  COEFFICIENTS.  Two  multiple-correlation  coefficients 
were  calculated  and  analyzed.  The  intent  here  was  to  determine  how  well  one 
could  predict  or  determine  the  separation  error  knowing  the  range  error  and 
az.muth  error  characteristics. 

The  first  question  was  to  determine  how  well  one  could  predict  the  separation 
error  knowing  the  range  error  and  azimuth  error  of  a single  aircraft. 
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The  average  multiple-correlation  coefficient  was  .388,  which  means  that  about 
15  percent  (.388^)  of  the  variability  of  the  separation  error  could  be  accounted 
for  by  knowing  the  range  error  and  azimuth  error  of  a SINGLH  aircraft.  This 
indicates  that  the  prediction  is  relatively  weak. 

This  being  the  case,  how  much  better  does  our  prediction  become  if  we  know  the 
range  ei ror  and  the  azimuth  error  of  both  aircraft  for  which  the  separation 
error  estimate  is  desired? 

To  do  this,  we  need  to  know  the  range  error  of  each  aircraft,  the  azimuth  error 
of  each  aircraft,  i.nd  the  cross-correlation  coefficient  for  each  of  these  four 
responses.  Given  this  information,  the  multiple-correlation  coefficient  was 
.851.  This  indicates  that  about  72  percent  (.851^)  of  the  variability  could 
now  be  accounted  for  by  knowing  the  range  error  and  azimuth  error  of  both 
aircraft  rather  than  for  just  one  of  the  aircraft.  Thus  our  prediction  is 
pretty  good  now. 
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TABLE  I.  OVERVIEW  OF  SYSTEM  RESPONSE  MEASURES 
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m m m m * cn  cn  * m * mmmmmm*«>-mm* 
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♦ * cn  * mm*  cncncnmmmmmmmmmmm 

* * C * CC  cccccccccccccc 


* * * m * cn  cn  * cncnencncncncncncncncncncn 

* * * C C C * CGCCGCCCCCCCC 


* * m * m * cnmmcnc^mmmmmcnm*  mm 

* * C * C CCGC-KGCGCGCC  CC 


* * m * mmcnmenmcncn*  mmmmmmmm 

* * e * cccccccc  cccccccc 


* * m * mm**  m cn  ^-  * mmmmmc'-mmm 

* * e * c c * c c * ccccc-xccc 


* cn  m cn  cn  * mmmcnmmcnmmmcncnmmf 

* c e c c * cccccccccccccc 


r in  * * in  * in  in  * cnt-cnmcncnmcnc'-cnmcn 

* C * * C * CC*  c * cccccc  ccc 


cn  * * * * * mmmmmmmmmmmmmm<^ 

C * * * X * CCCCCCCCCCCCCC* 


m * * * * mm**  mmmmmmmmmmm 

C****  CC  * ccccccccccc 


rn****  mmmmmmmmm***  m** 
C * * * CCCCCCCCC  * c « 


* m**  m*  mm*  mc'-mmmmm*  w « m c- 

* c**  e * cc*  e * ccccc*  ccc 


QOQGC5HHc-iH0d(XcrfO'O-fe 
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not  significant 
significant  <?  .05 
significant  @ .01 

questionable  interpretation  due  to  gross  unequality  in  the  number  of  entries  in  the  two-way  table 


TABLE  II-l.  POSITION  ERROR,  MEAN 


Significance  Level  (Probability) 


D 

T 

R 

Q 

F 

A 

D 

.0000 

.0000 

.0000 

.0000 

.0000 

T 

.7985 

.8056 

.6344 

.7704 

.5612 

R 

.0072 

.0086 

.0067 

.0079 

.0008 

Q 

.0 

.0000 

.0 

.0 

.0000 

F 

.1773 

.1728 

.2022 

.0876 

.1630 

A 

.0000 

.0000 

.0000 

.0054 

.0000 

DT 

.4375 

DR 

.0814 

DQ 

.0001 

DF 

.0979 

DA 

.0168 

TR 

.5334 

TQ 

.5690 

TF 

.4075 

TA 

.2297 

RQ 

.5638 

RF 

.0000 

RA 

.1036 

QF 

.0364 

QA 

.0274 

FA 

.0065 

TABLE  II-2 . 

POSITION  ERROR,  LOG 

VARIANCE 

Significance  Level 

(Probability) 

D 

T 

R 

Q 

F 

A 

D 

.0000 

.0000 

.0000 

.OoOO 

.0001 

T 

.9005 

.8849 

.9275 

.8514 

.6782 

R 

.0005 

.0005 

.0002 

.0001 

.0003 

Q 

.0000 

.0000 

.0000 

.0000 

.0993 

F 

.0136 

.0137 

.0440 

.0084 

.0142 

A 

.0000 

.0000 

.0000 

.0000 

.0000 

DT  .7850 
DR  .7347 
DQ  .4115 
DF  .8228 
DA  .1805 
TR  .5857 
TQ  .3617 
TF  .2508 
TA  .2182 
RQ  .0360 
RF  .0000 
RA  .0485 
QF  .1962 
QA  .0024 
FA  .0008 
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TABLE  II-3.  SEPARATION  ERROR,  MEAN 
Significance  Level  (Probability) 


D 

T 

R 

Q 

F 

A 

D 

.0000 

.0000 

.0000 

.0000 

.0000 

T 

.0796 

.0827 

.0348 

.0883 

.1277 

R 

.0000 

.0000 

.0000 

.0000 

.0004 

Q 

.0009 

.0005 

.0009 

.0006 

.2713 

F 

.0009 

.0016 

.0030 

.0007 

.0012 

A 

.0000 

.0000 

.0000 

.0000 

.0000 

DT  .4835 
DR  .7516 
DQ  .0401 
DF  .0090 
DA  .8345 
TR  .7515 
TQ  .1352 
TF  .4264 
TA  .6867 
RQ  .1955 
RF  .1143 
RA  .2838 
QF  .5122 
QA  .1211 
FA  .5873 


TABLE  II-4.  SEPARATION  ERROR,  LOG  VARIANCE 
Significance  Level  (Probability) 


D 

T 

R 

Q 

F 

A 

D 

.4675 

.5124 

.2537 

.4499 

.5363 

T 

.0000 

.0000 

.0000 

.0000 

.0000 

R 

.0011 

.0012 

.0007 

.0000 

.0154 

Q 

.0000 

.0000 

.0000 

.0000 

.0000 

F 

.0000 

.0000 

.0000 

.0000 

.0000 

A 

.0000 

.0000 

.0000 

.0000 

.0000 

DT  .2133 
DR  .7589 
DQ  .1870 
DF  .3713 
DA  .8116 
TR  .7925 
TQ  .1040 
TF  .0432 
TA  .8969 
RQ  .4837 
RF  .1777 
RA  .5033 
QF  .3354 
Qa  .1434 
FA  .0447 


45 


TABLE  11-5.  RANGE  ERROR,  MEAN 


Significance  Level  (Probability) 


D 

T 

R 

Q 

F 

A 

D 

.0 

.0 

.0 

.0 

.0 

T 

.5176 

.6633 

.8974 

.6369 

.6049 

R 

.0000 

.0000 

.0000 

.0000 

.0000 

Q 

.0000 

.0000 

.0000 

.0000 

.0000 

F 

.0214 

.0367 

.1321 

.0094 

.0283 

A 

.0000 

.0000 

.0000 

.0015 

.0000 

DT 

.4718 

DR 

.9066 

DQ 

.0000 

DF 

.5300 

DA 

.0010 

TR 

.3123 

TQ 

.2953 

TF 

.1200 

TA 

.5017 

RQ 

.0390 

RF 

.4174 

RA 

.0385 

QF 

.0428 

QA 

.2209 

FA 

.2081 

TABLE  11-6. 

RANGE  ERROR,  LOG 

VARIANCE 

Significance  Level 

(Probability) 

D 

T 

R 

Q 

F 

A 

D 

.0 

.0 

.0 

.0 

.0 

T 

.9243 

.913? 

.8348 

.9018 

.7755 

R 

.9266 

.9042 

.9328 

.9436 

.7451 

Q 

.3095 

.2703 

.2827 

.3123 

.1898 

F 

.0916 

.1150 

.1348 

.1207 

.1163 

A 

.0000 

.0000 

.0000 

.0000 

.0000 

DT  .8929 
DR  .0268 
DQ  .6047 
DF  .2351 
DA  .0693 
TR  .1731 
TQ  .6738 
TF  .9738 
TA  .5612 
RQ  .6313 
RF  .1463 
RA  .1815 
QF  .1139 
QA  .4«70 
FA  .0021 


46 


TABLE  II-7c  AZIMUTH  ERROR,  MEAN 


Significance  Level  (Probability) 


D 

T 

R 

Q 

F 

A 

D 

.0000 

.0000 

.0000 

.0000 

.0000 

T 

.0003 

.0003 

.0003 

.0005 

.0006 

R 

.1220 

.1430 

.2380 

.1629 

.1407 

Q 

.0000 

.0000 

.0000 

.0000 

.0001 

F 

.5060 

.5670 

.6032 

.5028 

.5951 

A 

.3217 

.3449 

.5463 

.5647 

.2851 

DT 

.0000 

DR 

.0346 

DQ 

.3886 

DF 

.3707 

DA 

.0273 

TR 

.0112 

TQ 

.1253 

TF 

.4163 

TA 

.2486 

RQ 

.3377 

RF 

.2092 

RA 

.0052 

QF 

.4055 

QA 

.7352 

FA 

.2744 

TABLE  11-8. 

AZIMUTH  ERROR,  LOG 

VARIANCE 

Significance  Level 

(Probability) 

D 

T 

R 

Q 

F 

A 

D 

.0000 

.0000 

.0000 

.0000 

.0000 

T 

.0154 

.0164 

.0028 

.0118 

.0274 

R 

.0039 

.0047 

.0066 

.0014 

.0206 

Q 

.0000 

.0000 

.0000 

.0000 

.0000 

F 

.0000 

.0000 

.0000 

.0000 

.0000 

A 

.0001 

.0002 

.0007 

.0116 

.0001 

DT  .1222 
DR  .5185 
DQ  .9689 
DF  .1934 
DA  .6329 
TR  .6822 
TQ  .0390 
TF  .0384 
TA  .1340 
RQ  .7540 
RF  .0557 
RA  .0555 
QF  .0652 
QA  .3154 
FA  .0822 
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TABLE  11-9. 

CORRELATION,  RANGE 
Significance  Level 

D 

T R 

.0001  .0001 

, 

.0000 

.0000 

K 

. 7 7 7 5 

.7558 

, i 

.0000 

.0000  .0000 

. 8679 

.8685  .9471 

A 

.0116 

.0081  .0139 

DT 

.0751 

DR 

.6441 

DC 

.2145 

DF 

.6055 

DA 

.0193 

TR 

.6995 

TQ 

. 3377 

IF 

.0544 

TA 

.3672 

RQ 

.1403 

RF 

.1592 

RA 

.5846 

QF 

.0195 

QA 

.7413 

FA 

.5902 

TABLE  11-10. 

CORRELATION,  RANGE 
Significance  Level 

D 

T R 

D 

.000  .000 

T 

.0218 

.0475 

R 

.000 

.0003 

Q 

.0578 

.1143  .1008 

F 

.0041 

.0099  .0112 

A 

.3520 

.2488  .0415 

DT 

.3423 

DR 

.0012 

DQ  1 

.7793 

DF 

.3598 

DA 

.5516 

TR  ! 

.1389 

TQ 

.3599 

TF 

.2722 

TA  ! 

.6471 

RQ 

.8739 

RF  1 

.0815 

:a 

1 .3659 

QF 

j .6669 

QA 

.9820 

FA 

.0539 

ERROR  VERSUS  AZIMUTH  ERROR  (COR  R to  A 


(Probability) 


Q 

F 

A 

0002 

.0001 

.0001 

0000 

.0000 

.0000 

9300 

.8681 

.6810 

.0000 

.0000 

9113 

. 5673 

1673 

.0054 

ERROR  VERSUS  RANGE  ERROR  (COR  R1  to  R2) 


(Probability) 


Q 

F 

A 

.000 

.000 

.000 

.0652 

.0463 

.0413 

.0003 

.0006 

.0001 

.1133 

.1642 

.0141 

.2381 

.3127 

.0371 
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TABLE  11-11.  CORRELATION,  AZIMUTH  ERROR  VERSUS  AZIMUTH  ERROR  (COR  A1  to  A2) 


Significance  Level  (Probability) 


D 

T 

R 

Q 

F 

A 

D 

.0017 

.0018 

.0041 

.0015 

.0015 

T 

.0143 

.0161 

.0133 

.0181 

.0123 

R 

.7441 

.7650 

.7399 

.7862 

.9503 

Q 

.0069 

.0067 

.0076 

.0060 

.0329 

F 

.1299 

.1493 

.2346 

.1351 

.0983 

A 

.5301 

.4619 

.4860 

.4930 

.3541 

DT  .0317 
DR  .6041 
DQ  .0942 
DF  .5931 
DA  . 5306 
TR  .5611 
TQ  .9820 
TF  .0521 
TA  .9006 
RQ  .7664 
RF  .0982 
RA  .4360 
QF  .8061 
QA  .6716 
FA  .8412 


TABLE  11-12.  MULTIPLE  CORRELATION,  RANGE  AND  AZIMUTH  ERROR  ON  SEPARATION  ERROR 
(RSQ  R,  A,  on  SE) 


Significance  Level  (Probability) 


D 

T 

R 

Q 

F 

A 

D 

.3101 

.2770 

.4697 

.3371 

.3202 

T 

.0575 

.0580 

.0555 

.0580 

.1258 

R 

.6447 

.6807 

.9092 

.4275 

.7364 

Q 

.4772 

.4552 

.4850 

.4922 

.9862 

F 

.0536 

.0467 

.0167 

.0291 

.0307 

A 

,104b 

.1136 

.0882 

.1316 

.1188 

DT  .9321 

DR  .0006 

DQ  .1669 

DF  .0208 

DA  .5796 

TR  .8962 

TQ  .8691 

TF  .4694 

TA  .1010 

RQ  .1407 

RF  .0005 

RA  .0008 

QF  .3647 

QA  .4415 

FA  .0056 
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TABLE  11-13.  MllLI.Il’LE  CORRECTION,  RANGE  ERROR  1 AND  2 AND  AZIMUTH  ERROR 
1 AND  2 ON  SEPARATION  ERROR  (RSQ  Rx,  R2,  Al,  A2,  on  SE) 


Significance  Level  (Probability) 


D 

T 

R 

Q 

F 

A 

D 

.2849 

.3140 

.2573 

.2910 

.3935 

T 

.1738 

.1937 

.0990 

.1347 

.1777 

R 

.1519 

.1662 

.1133 

.1208 

.0572 

Q 

.0031 

.0029 

.0022 

.0007 

.0045 

F 

.000 

.000 

.000 

.0000 

.0000 

A 

.0781 

.0759 

.0469 

.0540 

.0088 

DT  .5821 

DR  .7420 

DQ  .8273 

DF  .5127 

DA  .8943 

TR  .7623 

TQ  .1088 

TF  .0784 

TA  .7656 

RQ  .1407 

RF  .000 

RA  .0008 

QF  .0723 

QA  .1862 

FA  .0231 
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TABLE  III-l.  DXT  AVERAGES* 


Position 

Error  - 

Mean 

Position  Error  - 

Variance 

T1 

T2 

Wt  Avg 

T1 

T2 

Wt  Avg 

D1 

.5846 

.6191 

.6016 

D1  .0984 

.1195 

.1088 

D2 

.7709 

.7536 

.7623 

D2  .1761 

.1572 

.1667 

Wt  Avg 

.6794 

.6877 

.6835 

Wt  Avg  .1379 

.1387 

.1383 

Separation  Error 

- Mean 

Separation  Error 

- Variance 

T1 

T2 

Wt  Avg 

T1 

T2 

Wt  Avg 

D1 

.0094 

.0226 

.0159 

D1  .0206 

.0322 

.0263 

D2 

.0886 

.1194 

.1038 

D2  .0186 

.0370 

.0277 

Wt  Avg 

.0496 

.0720 

.0606 

Wt  Avg  .0196 

.0346 

.0270 

Range  Error  - Mean 

Range  Error  - Variance 

T1 

T2 

Wt  Avg 

T1 

T2 

Wt  Avg 

D1 

-.0924 

-.1555 

-.1235 

D1  .0295 

.0358 

.0326 

D2 

.5733 

.5766 

.5749 

D2  .1541 

.1566 

.1553 

Wt  Avg 

.2462 

.2179 

.2322 

Wt  Avg  .0928 

.0974 

.0951 

Azimuth  Error  - Mean 

Azimuth  Error  - Variance 

T1 

T2 

Wt  Avg 

T1 

T2 

Wt  Avg 

D1 

-.0137 

.0126 

-.0007 

D1  .0292 

.0355 

.0323 

D2 

.3592 

.1091 

.2354 

D2  .0208 

.0270 

.0239 

Wt  Avg 

.1760 

.0618 

.1195 

Wt  Avg  .0249 

.0312 

.0280 

COR  - Range  Error 

, Azimuth 

i Error 

RSQ  - Sep.  Error 

on  Range  & Azimuth  Erro; 

T1 

T2 

Wt  Avg 

T1 

T2 

Wt  Avg 

D1 

.4723 

.4238 

.4484 

D1  .3583 

.3975 

.3777 

D2 

.5804 

.4644 

.5230 

D2  .3835 

.4119 

.3976 

Wt  Avg 

.5273 

.4445 

.4864 

Wt  Avg  .3711 

.4048 

.3878 

Ct)R  - Azimuth  Error,  Azimuth  Error 

COR  - Range  Error 

, Range  Error 

T1 

T2 

Wt  Avg 

T1 

T2 

Wt  Avg 

D1 

.2825 

.2520 

.2673 

D1  .6676 

.6163 

.6420 

D2 

.5583 

.3287 

.4435 

D2  .9016 

.8570 

.8793 

Wt  Avg 

.4232 

.2911 

.3572 

Wt  Avg  .7870 

.7391 

.7631 

RSQ  - Sep 

. Error  i 

on  Range 

Error  Aircraft 

No.  16.2 

and 

Azimuth 

Error  Aircraft 

No.  1&2 

T1 

T2 

Wt  Avg 

D1 

.8407 

.8742 

.8575 

D2 

.8211 

.8675 

.8443 

Wt  Avg 

.8307 

.8708 

.8507 

•Weighted  Average 

(Wt  Avg) 

- All  row  and 

, column  averages 

are  weighted 

averages. 

The  final  (lower 

right)  o 

ntry  for  each 

data  block  was  constructed  on 

the  total 

weighted 

average 

for  the 

whole  matrix. 

The  weights  used 

were  determined  by  the 

number  of  observations  in 

the  cells  of 

the  tables. 
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Position  Error  - Mean  Position  Error  - Variance 

Ri  R2  R3  R4  Ut  Avg  R1  R2  R3  R4  Wt  Avg 

D1  .5381  .6214  .5461  .6949  .6016  D1  .1061  .0582  .1666  .1063  .1088 

D2  .8289  .6705  .6973  .8513  .7623  D2  .2859  .0848  .1254  .1078  .1668 
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♦Weighted  Average  (Wt  Avg)  - All  row  and  column  averages  are  weighted  averajes.  The  final  (lower  right)  entry  for 
each  data  block  was  constructed  on  the  total  weighted  average  for  the  whole  matrix.  The  weights  used  were 
determined  by  the  number  of  observations  in  tue  cells  of  the  tables. 


TABLE  I I 1-3.  DXQ  AVERAGES* 


Position 

Error  - 

Mean 

Position  Error  - 

Variance 

Ql 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Avg 

D1 

.4960 

.7621 

.6016 

D1 

.0849 

.1451 

.1088 

D2 

.5537 

.0604 

.7623 

D2 

.1030 

.2578 

.1667 

Wt  Avg 

.5250 

.9168 

.6835 

Wt  Avg 

.0940 

.2035 

.1383 

Separation  Error 

- Mean 

Separation 

i Error 

- Variance 

Ql 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Avg 

D1 

.0095 

.0259 

.0158 

D1 

.0185 

.0386 

.0263 

D2 

.0761 

.0446 

.1038 

D2 

.0204 

.0382 

.0276 

Wt  Avg 

.0429 

.0876 

.0606 

Wt  Avg 

.0195 

.0384 

.0269 

Range  Error  - Mean 

Range  Error  - Variance 

Ql 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Avg 

D1 

-.0982 

-.1621 

-.1236 

D1 

.0299 

.0367 

.0326 

D2 

.2097 

1.0968 

.5750 

D2 

.1614 

.1467 

.1553 

Wt  Avg 

.0567 

.4907 

.2322 

Wt  Avg 

.0961 

.0937 

.0951 

Azimuth  Ei ror  - Mean 

Azimuth  Error  - Variance 

Ql 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Avg 

D1 

-.0745 

.1113 

-.0007 

D1 

.0263 

.0415 

.0323 

D2 

.1814 

.3125 

.2354 

D2 

.0164 

.0345 

.0239 

Wt  Avg 

.0543 

.2156 

.1195 

Wt  Avg 

.0213 

.0379 

.0280 

COR  - Ran 

ge  Error 

, Azimuth 

Error 

RSQ  - Sep. 

Error 

on  Range  & Azimuth  Error 

Ql 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Avg 

D1 

.4846 

.3931 

.4483 

D1 

.3620 

.4014 

.3776 

D2 

.5803 

.4410 

.5229 

D2 

.4048 

.3872 

.3976 

Wt  Avg 

.5328 

.4179 

.4863 

Wt  Avg 

.3835 

.3940 

.3878 

COR  - Azimuth  Error,  Azimuth  Error 

COR  - Range  Error 

, Range  Error 

Ql 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Avg 

D1 

.2854 

.2417 

.2673 

D1 

.6552 

.6233 

.6420 

02 

.5420 

.3105 

.4435 

D2 

.8768 

.8826 

.8793 

Wt  Avg 

.4153 

.2772 

.3572 

Wt  Avg 

.7674 

.7572 

.7531 

RSQ  - Sep 

. Error  ■ 

on  Range 

Error  Aircraft 

No.  1& 2 

and 

Az  i muth 

Error  Aircraft 

No.  lf.2 

Ql 

Q2 

Wt  Avg 

1)1 

.8303 

.895  7 

.8575 

02 

.8176 

.8804 

.8443 

Wt  Avg 

.8239 

.8878 

.8507 

*Weighted 

Ave  rn  ge 

(Wt  Avg) 

-All  row  and 

column  averages 

are  weighted 

averages. 

The  final  (lower 

right)  entry  for  each 

data  block 

was  constructed  on 

the  total 

weighted 

average 

for  the 

whole  matrix. 

The  weights  used 

were  determined  by  the 

number  of  observations  in 

the  cells  of 

the  tables 
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Position  Error  - Moan  Position  Error  - Variance 
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♦Weighted  Average  (Wt  Avg)  - All  row  and  column  averages  are  weighted  averages. 
The  final  (lower  right)  entry  for  each  data  block  was  constructed  on  the  total 
weighted  average  for  the  whole  matrix.  The  weights  used  were  determined  by  the 
number  of  observations  in  the  cells  of  the  tables. 


TAKLK  II 1-5.  DXA  AVKRACKS* 
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♦Weighted  Average  (Wt  Avg)  - All  row  and  column  averages  are  weighted  averages.  The  final  (lower  right)  entry  for 
each  data  block  was  constructed  on  the  total  weighted  average  for  the  whole  matrix.  The  weights  used  were 
determined  by  the  number  of  observations  in  the  cells  of  the  tables. 


TABI.K  Ill-h.  TXR  AVtKAUS* 


TABLE  I I 1-7.  TXQ  AVERAGES* 


Position 

Error  - 

Mean 

Position  Error  - 

Vari ance 

Q1 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Avg 

T1 

.5083 

.9182 

.6793 

T1 

.0842 

.2130 

.1379 

T2 

.5414 

.9152 

.6877 

T2 

.1036 

.1933 

.1387 

Wt  Avg 

.5250 

.9168 

.6835 

Wt  Avg 

.0940 

.2036 

.1383 

Separation  Error 

- Mean 

Separation  Error 

- Variance 

Q1 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Avg 

T1 

.0387 

.0651 

.0496 

T1 

.0156 

.0252 

.0196 

T2 

.0470 

.1130 

.0720 

T2 

.0233 

.0533 

.0347 

Wt  Avg 

.0429 

.0876 

.0606 

Wt  Avg 

.0195 

.0384 

.0270 

Range  Error  - Mean 

Range  Error  - Variance 

Q1 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Avg 

T1 

.0371 

.4684 

.2464 

T1 

.0886 

.0988 

.0929 

T2 

.0270 

.5149 

.2180 

T2 

.1033 

.0882 

.0974 

Wt  Avg 

.0567 

.4906 

.2322 

Wt  Avg 

.0960 

.0937 

.0951 

Azimuth  Error  - Mean 

Azimuth  Error  - Variance 

Q1 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Av° 

T1 

.0895 

.2967 

.1760 

11 

.0206 

.0311 

.0250 

T2 

.0198 

.1272 

.0618 

T2 

.0220 

.0452 

.0311 

Wt  Avg 

.0543 

.2156 

.1195 

Wt  Avg 

.0213 

.0378 

.0280 

COR  - Range  Error 

, Azimuth  Error 

RSQ  - Sep. 

Error 

on  Range  6 Azimuth  Erro 

Q1 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Avg 

T1 

.5684 

.4697 

.5272 

T1 

.3678 

.3758 

.3711 

T2 

.4978 

.3615 

.4445 

T2 

.3989 

.4140 

.4048 

Wt  Avg 

.5321 

.4179 

.4863 

Wt  Avg 

.3835 

.3941 

.3878 

COR  - Azimuth  Error,  Azimuth  Error 

COR  - Range  Error 

, Range  Error 

Ql 

Q2 

Wt  Avg 

Ql 

Q2 

Wt  Avg 

T1 

.4722 

.3577 

.4232 

T1 

.8144 

.7503 

.7870 

T2 

.3597 

.1941 

.2911 

T2 

.7214 

.7643 

.7391 

Wt  Avg 

.4153 

.2772 

.3572 

Wt  Avg 

.7674 

.7572 

.7631 

RSQ  - Sep. 

Error 

on  Range 

Error  Aircraft 

: No.  1&2 

and 

Azimuth 

Error  Ai rcraf t 

. No.  162 

Ql 

Q2 

Wt  Avg 

T1 

.8090 

.8598 

.8307 

T2 

.8384 

.9167 

.8708 

Wt  Avg 

.8239 

.8878 

.8507 

♦Weighted  Average 

(Wt  Avg) 

- All  row  and 

column  averages 

are  weighted 

averages. 

The  final 

(lower 

right)  entry  for  each 

data  block 

was  constructed  on 

the  total 

weighted 

average 

for  the 

whole  matrix. 

The  weights  used 

were  determined  by  the 

number  of 

observations  in 

the  cells  of 

the  tables 

• 
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TABI.K  111-8.  TXK  AVERACES* 
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♦Weighted  Average  (Wt  Avg)  - All  row  and  column  averages  are  weighted  averages.  The  final  (lower  right) 
entry  for  each  data  blcck  was  constructed  on  the  total  weighted  average  for  the  whole  matrix.  The 
weights  used  were  determined  by  the  number  of  observations  in  the  cells  of  the  tables. 


IAIU1  lU-‘).  TXA  AVKRACiKS* 


*Weighted  Average  (Wt  Avg)  - All  row  and  column  averages  are  weighted  averages.  The  final  (lower  right)  entry  for 
each  data  block  was  constructed  on  the  total  weighted  average  for  the  whole  matrix.  The  weights  used  were 
determined  by  the  number  of  observations  in  the  cells  of  the  tables. 


TABLE  III-10.  RXQ  AVERAGES* 


Position 

Error  - 

Mean 

Q1 

Q2 

Wt  Avg 

R1 

.5088 

.9647 

.6916 

R2 

.5097 

.8427 

.6459 

R3 

.4662 

.8688 

.6232 

R4 

.6184 

.9895 

.7735 

Wt  Avg 

.5250 

.9168 

.6835 

Separation  Error 

- Mean 

Wt  Avg 

Q1 

Q2 

R1 

.0334 

.1098 

.0626 

R2 

.0483 

.0662 

.0556 

R3 

.0124 

.0254 

.0173 

R4 

.0805 

.1468 

.1079 

Wt  Avg 

.0429 

.0876 

.0606 

Range  Error  - Mean 


Q1 

Q2 

Wt  Avg 

Rl 

.1616 

.8448 

.4356 

R2 

-.0040 

.3404 

.1368 

R3 

.0943 

.5102 

.2565 

R4 

-.0260 

.2880 

.1052 

Wt  Avg 

.0567 

.4907 

.2322 

Azimuth 

Error  - 

Mean 

Ql 

Q2 

Wt  Avg 

R1 

-.0047 

.2146 

.0832 

R2 

.0401 

.2578 

.1291 

R3 

.0606 

.1415 

.0922 

R4 

.1218 

.2438 

.1728 

Wt  Avg 

.0543 

.2156 

.1196 

COR  - Range  Error,  Azimuth  Error 


Ql 

Q2 

Wt  Avg 

R1 

.5322 

.4119 

.4840 

R2 

.4881 

.4476 

.4715 

R3 

.5497 

.4181 

.4984 

R4 

. 16 

.3942 

.4916 

Wt  Avg 

.5328 

.4180 

.4863 

COR  - Azimuth  Error 

, Azimuth 

Error 

Ql 

Q2 

Wt  Avg 

R1 

.3898 

.2005 

.3075 

R2 

.3985 

.2732 

.3467 

R3 

.4673 

.2614 

.3832 

R4 

.4046 

.3674 

.3888 

Wt  Avg 

.4153 

.2772 

.3572 

Position 

Error  - 

Variance 

Ql 

Q2 

Wt  Avg 

Rl 

.0911 

.3653 

.2011 

R2 

.0489 

.1040 

.0714 

R3 

.1604 

.1223 

.1455 

R4 

.0740 

.2253 

.1372 

Wt  Avg 

.0940 

.2036 

.1383 

Separation  Error 

- Variance 

Ql 

Q2 

Wt  Avg 

Rl 

.0163 

.0289 

.0211 

R2 

.0242 

.0421 

.0315 

R3 

.0177 

.0343 

.0240 

R4 

.0199 

.0476 

.0313 

Wt  Avg 

.0195 

.0384 

.0270 

Range  Error  - Variance 

Ql 

Q2 

Wt  Avg 

Rl 

.1111 

.1157 

.1129 

R2 

.0706 

.0729 

.0715 

R3 

.1272 

.0915 

.1133 

R4 

.0744 

.0956 

.0833 

Wt  Avg 

.0960 

.0937 

.0951 

Azimuth 

Error  - 

Variance 

Ql 

Q2 

Wt  Avg 

Rl 

.0196 

.0312 

.0243 

R2 

.0198 

.0289 

.0235 

R3 

.0198 

.0488 

.0311 

R4 

.0262 

.0427 

.0331 

Wt  Avg 

.0213 

.0378 

.0280 

RSQ  - Sep.  Error  on  Range  & 

Azimuth  Error 

Ql 

Q2 

Wt  Avg 

Rl 

.3734 

.4058 

.3864 

R2 

.4205 

.3790 

.4035 

R3 

.3449 

.4106 

.3705 

R4 

.3961 

.3827 

.3905 

Wt  Avg 

.3835 

.3941 

.3878 

COR  - Range  Error,  Range  Error 


Ql 

Q2 

Wt  Avg 

Rl 

.8117 

.7790 

.7975 

R2 

.6844 

.6836 

.6841 

R3 

.7839 

.7815 

.7829 

R4 

.7959 

.7860 

.7917 

Wt  Avg 

.7674 

.7572 

.7631 
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TABLE  III-10.  RXQ  AVERAGES*  (continued) 


RSQ  - Sep.  Error  on  Range  Error  Aircraft  No.  1&2 
and  Azimuth  Error  Aircraft  No.  1&2 


Q1 

Q2 

Wt  Avg 

R1 

.8004 

.8495 

.8218 

K 2 

.8576 

.8190 

.8417 

R3 

.7682 

.9281 

.8335 

R4 

.8650 

.9536 

.9028 

Wt  Avg 

.8239 

.8878 

.8507 

*Weighted  Average  (Wt  Avg)  - All  row  and  column  averages  are  weighted  averages. 
The  final  (lower  right)  entry  for  each  data  block  was  constructed  on  the  total 
weighted  average  for  the  whole  matrix.  The  weights  used  were  determined  by  th 
number  of  observations  in  the  cells  of  the  tables. 
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Position  Error  - Moan  Position  F.rror  - Variant*? 

*1  A2  A3  A4  Ut  Avr  A1  A2  A3  A4  Wt  Avfc 

K1  .6270  .8296  .7794  .4364  .69lo  R1  .2232  .3117  .2102  .0330  .2011 
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Sep.  Error  on  Kange  Error  Aircraft  No.  i&2 
and  Azimuth  Error  Aircraft  No.  162 


TAHI.K  UI-I4.  <>XA  AVHRACKS* 


x 

> o *n  pa 

< -T  r-A  CC 


X 

> ^ <T  O 

< CC 

—•  rc  r" 

c-  O O 

l*  • • • 


oc 

> r>. 

< X cn  la 

(7s  O'  (T' 

*J  o c o 

^ • 


X 

> m oc  C 
«<  rH  a-  oo 
cm  cc  ci 
*-*  o c o 

u * • • 


oo 

> 'C  rH  00 

< m <T  r- 
oO  O'  CO 
*j  rA  pa  m 


OO 

;•  cm  rH 

< r-  m 

-C  00  x 

k->  r*-.  t-.  r*- 

U • • • 


C 

< • 


r->  O C C 

< • • • 


in  C h 
C cr 
in  n ^ 

C C C 


X r-  X 

H «J  ® 

n O'  C 

PA  r-t  O ri 
< • • • 


O in  OO 
O'  X o. 
h rn-i 

c c c 


X ~ 
rj  cn  f« 

«a  c o c 

< • • • 


pa  r-^  -y 
C (N  O 
r-.  X X 
vj  n ri  n 


3 cr  oc 

t n (*>  r>  n 

— < • • • 


h»  v£  lA 

K ® O 
in  x x 

< • . • 


CA  00  X X 

< • • * 


C o 
o u 
o 

^ 3 

kJ 

X -O 
X o 

•r-  X 

U 3 

V-  CO 
0 *- 
5 X 
c x 


i, 

— 

<r 

c 

iA 

O' 

rH 

f-l 

iA 

<y 

N 

o 

G 

x 

X 

r-^ 

PJ 

X 

rn 

X 

O' 

0 

O' 

X 

X 

X 

r 

-? 

X 

■— 

• — 1 

<“*■' 

ri 

Ci 

X 

c 

o 

—• 

r"> 

C4 

n 

<? 

CM 

r4 

U 

A4 

c 

c 

C 

o 

C4 

c 

p-4 

c 

C 4 

c 

o 

c 

c 

— 

< 

• 

• 

• 

3 

< 

k 

u 

< 

• 

• 

• 

o 

< 

• 

k 

k 

X 

U 

0» 

c 

— 

a 

u 

c 

> 

1 

—4 

<z 

G 

k. 

> 

1 

u 

u 

Cl 

C4 

uc 

c 

o 

C4 

A4 

> 

lA 

O' 

O' 

1 

O' 

Cl 

c 

>- 

c 

3 

X 

u 

X 

X 

X 

O' 

X 

o 

C 

u 

c 

Cl 

— • 

X 

u 

rj 

fC 

1 

X 

o 

O' 

t~ 

P~4 

<r 

m 

u 

w. 

•-4 

r— 1 

C4 

X 

«— 4 

c 

o 

c 

H 

o 

rH 

o 

0 

r-4 

c 

o 

O 

u: 

u 

< 

• 

• 

• 

< 

« 

• 

U 

< 

• 

• 

• 

u 

< 

• 

• 

• 

X 

c 

0 

u 

k 

0 

L4 

U1 

a 

c 

u 

o 

c 

u 

X 

X 

3 

u 

X 

*ml 

> 

U 

> 

o 

> 

3 

> 

i 



•3 

< 

X 

< 

E 

< 

'X 

C. 

c 

■r4 

r-y 

0 

r>4 

C4 

o 

1—1 

A4 

4J 

3 

rH 

C4 

N 

H 

C4 

M 

X 

o 

o 

3 

X 

o 

Qr 

u 

X 

o 

o 

If 

< 

O' 

O I* 

r> 

n rj  c 

r»>  0"  •— « 
in®  n 


k. 

W 

CO  <r  o 
g O'  ai  r 

X ci  -7  m 

C ri  N N N 

rc  <C  • • • 

X 


u n nj  o 

u oj  C -■ 

uj  r*.  — <r 

rH  r*  rs.  r- 

g < • • • 

X 

c 


X 

> 


m M U 

O'  O I* 


X 

I 


X 

> 


X 

c *-»  CM  *■» 

U O O'  If 


x 

> c CC  in 

< in  ® m 

rj  — ■ cc 
w in  o >C 
If  • • • 


C X ~ 
C O'  c 

X r-1  X 

-r  x <y 


n mi  tr  fx 


♦—  pm  rc 

o in  c 

A C A 

run  o r' 


> O'  X X 
< n N C 
-T  X X 
w C C O 

If  • • • 


rH  rH  in 

ci  ci  in 
— 'T  O 

«*  c c c 

< . . . 

I 


ca  X 

c c 


fl  o A 

coo 


Am® 
-*  X c 

vj  N n 

*o  c c c 

•0  i • • 

I I 


XXX 
X -T  X 
n X ^ 
C <T  Cl 


X O CO 
ri  m ® 
O'  X *-H 

cm  o cc  ci 


H A A 
O'  m fs 
x x 

vt  C Cl  C 


O X c 
<N  X r^ 

■O  A vT 
O ni  h 


in  o *■-» 

n mi  <r 

HAW 

04  O — * O 


r-  <r  X 
® A « 
iA  C <* 

4 A sj  A 


— * ci  r-. 

04  CM  cc 

.a  «a  c 

u n A *J  A. 

O <1  • • • 


u 

u 


*-*  <T  O'  X 

3 r*>  co  r~ 

a O -h  X 

•h  rj  in  >4 

N < 


O m <r 
m —<  r-. 
H 4 O 
'T  4 PI  A 

< • • • 


A h.  vC 

u x cr  in 

c m ff  M 

u ca  in  cm  <r 

v*  < • • • 

uz 


3 

E O 

•h  O'  0 '7 

N PJ  h P| 

C c*4  m pa  ri 

< 


CM  Cl 
X vQ 

o cn  o 
• • <r 

GO  r-  O'  c-j 

Z Z 't  O'  O'  O' 

< • • • 


u u 

u u 

k-  4 in  a o 

— X r-*  X 

< i r\  cc 

cc  <o  X 
v.  < • • • 

o n 
k-  v- 
h k- 
W UJ 

ox  <r  f-4  x 

X *-»  <r  rH  x 

c 3 <r  <r  oc 

r:  j;  n n ® n 

x •-*  < 


o 

X 

{— 


'J.  E 

X 0 

C z 
o X 
> 5 
c; 

o 

■3  X 


X 

OC 

5C 

X 

x r. 

> 

r>- 

cc 

> rc 

X 

> X 

PA 

> 

PA 

CM 

Cl 

> <T 

X 

r-s 

0 

< x 

c 

Cl 

< <r 

lA 

O' 

< C'i 

X 

X 

< 

iA 

f^. 

r-4 

< PA 

A4* 

c 

X *u 

iA 

O 

rc 

iA 

r— > 

PH 

p-4 

X 

f-H 

X 

C4 

X 

lA, 

r:  o 

H*  c 

ci 

u O 

CM 

r-4 

->  lA 

<* 

kJ 

<r 

Cl 

rc 

kJ  X 

X 

X 

u>  *-» 

3 • 

3 • 

• 

• 

3 • 

* 

• 

3 

• 

• 

* 

3 • 

• 

• 

O X 
> X 

a o 

>-  Jm  *-» 

rs  o 

> w- 
O 

X 


o o 
3 X 


E 

3 — 
r-  •_!  C c 


X 

c 


> c 

G C > 
W-  O u. 
O 

I—  “O  CT. 
rH  C4  X 
<C  4J  o 

o /. 

I 3 'r-. 
U G 

X X a 

> c o 

< O X 

O E 


f3 

X 

c 

< 

4> 

N 

O w 

G 

o 

3 

u 

C 

< 

w a 

?: 

1 

c 

V 

•> 

o 

o 

3 

0) 

r3 

21 

k- 

M 

"O 

a> 

X 

i 

l_ 

O 

o 

k4 

k- 

c 

X -V 

H 

rH 

X 

0 

o 

rH 

51  ^ 

X 

X 

1 kA 

X 

O' 

k-  o 

m 

CM 

U 

Cl 

<r 

0 

C3 

r^- 

CA 

-Cf 

3 u 

u 

X 

O' 

X 

k- 

X 

C4 

iA 

C4 

P^p 

CM 

rH 

X 

rH 

V-.  PA 

PA 

o 

o 

CM 

PA 

u 

rH 

rH 

X 

k.  o 

0 

iA 

X 

3 

u 

O' 

rH 

o 

1 X 

PA 

O' 

k4 

rH 

'T 

W rH 

X 

in 

3= 

o 

CM 

rH 

k4 

X 

O' 

X 

OJ  rH 

X 

V4 

rH  in 

X 

UJ 

rH  O 

rH 

rH  rH 

X 

PA 

O r4  O 

CM 

rH 

rH  iA 

CA 

4-4 

rH 

CM 

CA 

u 

rH 

X 

X 

X 

> X 

k- 

< • 

k 

k 

< • 

• 

• 

k4  < • 

• 

• 

k4  < • 

• 

• 

0)  < • 

• 

• 

3 

< 

• 

• 

• 

< 

• 

• 

4 

< 

*3 

w 

c 

o 

k4 

X 

E 

• 

CJ 

<D 

o 

u 

UJ 

c 

CO 

•a  4J 

C 

c 

•—4 

u 

N 

OJ 

a»  cj 

•rH 

o 

4-1 

Ul 

X 

X 

< 

X 

u x 

—4 

X 

3 

X 

X 

4J 

X 

X 

X 

X 

X 

c 

*-> 

> 

u 

> 

o 

> 

3 

> 

1 

> 

1 

> 

1 

> 

X x 

nJ 

•H 

< 

rj 

< 

X 

< 

E 

< 

< 

< 

< 

♦4H  u 

4J 

X 

a 

c 

X 

X 

O' 

O C3 

o 

o 

p— • 

CJ 

4H 

o 

A4 

4-4 

3 rH 

CM 

4-1 

N rH 

CM 

4-1 

C rH 

CM 

kJ 

O 

rH 

Ci 

u 

X 

rH 

CM 

4H 

If  CJ 

X) 

X 

O' 

O U 

X 

O'  O' 

If 

X O'  O'  n 

< O O'  ^ 

O O'  o If 

u 

Cr  or  is 

X 

O'  O'  If 

* 

65 


J 


TAJ5LE  I II- 15.  fXA  AVERAGES* 
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♦Weighted  Average  (Wc  Avg)  - All  row  and  column  averages  are  weighted  averages.  The  final  flower  right)  entry  for 
each  data  block  was  constructed  on  the  total  weighted  average  for  the  whole  matrix.  The  weights  used  were 
determined  by  the  number  of  observations  in  the  cells  of  the  tables. 


